-- Logs begin at Mon 2021-10-18 18:05:08 UTC, end at Mon 2021-10-18 19:11:27 UTC. -- Oct 18 18:33:21.937845 dv-cinder-813220-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 18 18:33:21.948136 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 18 18:33:21 2021] *** Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: nodename: dv-cinder-813220-2-iscsi Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: machine: x86_64 Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: clock source: unix Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: pcre jit disabled Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: detected number of CPU cores: 4 Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: current working directory: / Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: detected binary path: /usr/bin/uwsgi-core Oct 18 18:33:21.950182 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: your processes number limit is 47680 Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: your memory page size is 4096 bytes Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: detected max file descriptor number: 2048 Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: lock engine: pthread robust mutexes Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: thunder lock: enabled Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 18 18:33:21.950813 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 18 18:33:21.997594 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: Python main interpreter initialized at 0x55875519e9c0 Oct 18 18:33:21.997594 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: python threads support enabled Oct 18 18:33:21.997594 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: your server socket listen backlog is limited to 100 connections Oct 18 18:33:21.997594 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: your mercy for graceful operations on workers is 90 seconds Oct 18 18:33:21.997935 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 18:33:21.998013 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: *** Operational MODE: preforking *** Oct 18 18:33:21.998317 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: *** uWSGI is running in multiple interpreter mode *** Oct 18 18:33:21.998317 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: spawned uWSGI master process (pid: 109138) Oct 18 18:33:21.998510 dv-cinder-813220-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 18 18:33:21.999715 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: spawned uWSGI worker 1 (pid: 109152, cores: 1) Oct 18 18:33:21.999715 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: spawned uWSGI worker 2 (pid: 109153, cores: 1) Oct 18 18:33:21.999715 dv-cinder-813220-2-iscsi devstack@keystone.service[109138]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 18:33:27.069398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 18:33:27.069398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: from cryptography.utils import int_from_bytes Oct 18 18:33:27.070098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 18:33:27.070098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: from cryptography.utils import int_from_bytes Oct 18 18:33:27.070536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 18:33:27.070536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: from cryptography.utils import int_from_bytes Oct 18 18:33:27.070739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 18:33:27.070739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: from cryptography.utils import int_from_bytes Oct 18 18:33:27.118854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 18:33:27.119038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 18:33:27.119158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 18:33:27.119310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] command line args: [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 18:33:27.119905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 18:33:27.120004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 18:33:27.120142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] command line args: [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 18:33:27.120226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ================================================================================ {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 18:33:27.120426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] admin_token = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.120511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 18:33:27.120672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] config_dir = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.120760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ================================================================================ {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 18:33:27.120863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.120950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] admin_token = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] config_source = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] config_dir = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] debug = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.121772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] config_source = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] debug = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] insecure_debug = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.122931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] insecure_debug = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_config_append = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.123969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_dir = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_file = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_config_append = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_dir = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.124887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_file = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.125761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.126872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.127939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] notification_format = cadf {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] notification_format = cadf {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.128895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] publish_errors = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129548 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] publish_errors = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.129945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] standard_threads = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.130967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] strict_password_check = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] standard_threads = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] use_eventlog = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] strict_password_check = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] use_journal = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.131786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] use_json = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] use_stderr = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] use_eventlog = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] use_syslog = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] use_journal = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] use_json = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] watch_log_file = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.132984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] use_stderr = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.133118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.133246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] use_syslog = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.133373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.133511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] watch_log_file = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 18:33:27.133645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.133781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.135134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.135357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.135529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.136110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.136317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.136486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.136682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.136877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.137105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.137310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.137510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.137679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.137907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.138110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.138291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.138519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.138775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.138944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.139139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.139333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.139559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.139765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.139965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.140793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.141916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.142995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.143840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.144045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.144176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.144305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.144432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.147198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.147363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.147517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.147657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.148503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.148661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.148794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.148928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.149876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.150990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.151927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.152880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.153872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.154976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.155921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.156872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.157958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.enabled = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.158092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.159983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.160973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.enabled = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.161920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.162894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.external = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.mapped = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.163952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.password = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] auth.token = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.164896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] catalog.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.165963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.166615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.166758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.166900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.167959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.external = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.mapped = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.168900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.password = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] auth.token = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.169885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] catalog.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.170879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.171935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172753 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.172893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.173958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174682 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.174944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.175887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.176882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.177947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.178905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.179988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.180925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.181750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.182425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.182611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.182750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.182880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.183955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.184875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.password = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.185925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.186995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.187134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.187266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.187406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.187608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.187872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.188929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.password = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.189986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.190919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.191877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.192951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.193889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.194768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.195868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.196986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] policy.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.197994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] receipt.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.198869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.199831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.200925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] policy.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] revoke.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.201898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] role.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] receipt.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] role.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.202941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] role.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] role.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.203980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.204924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.205884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] revoke.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.206892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] role.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] role.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] role.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] role.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.207991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.208968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.209935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.210980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.211967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.212939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.provider = fernet {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.213957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.214957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] trust.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.215933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.216896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.provider = fernet {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.connection = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.217856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.218968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] trust.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.219929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.220875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.221752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.connection = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.222879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=109153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.223162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 18:33:27.224342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=109152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 18:33:27.231588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.231822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.232054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.234019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.234252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.234476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.241885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.244188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.270457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.270694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.270856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.270996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.323152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.323839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.465502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.465738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.467000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.467242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.531934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.532043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.532153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.532260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.532374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.555438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.555543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.555698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.555825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.555930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.556661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.557304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.557391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.568247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.568539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.580758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.580989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.581944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.582073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=109152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.582157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.582325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.582560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=109153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 18:33:27.599855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.600064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 18:33:27.600148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.600362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 18:33:27.600445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.600583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 18:33:27.600696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.600846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.600930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 18:33:27.601099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.601883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.612986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.613193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.623103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.623420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.626270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.626540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.626650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.626836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.626920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.627979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.628938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.629017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.629199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.655405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.655662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.656949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.657220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.657302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.657492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.662281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.662567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.662743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.662963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.663046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.663282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.670040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.670316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.670398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.670671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.674649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.674929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.675203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.675821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.676827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.694757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.695026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.695284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.695568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.699973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.700544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.703503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.703792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.704224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.704514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.708792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.709442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.712475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.712980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.716068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.716359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.716592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.716689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.716888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.716971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.717991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.736671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.736952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.737212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.737477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.740501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.741006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.741471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.741926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.745744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.747417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.747696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.750922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.751204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.751475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.751709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.751798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.751999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.753378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.753658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.756814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.757094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.757373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.757653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.757929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.765261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.765538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.765820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.766091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.766363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.766754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.767028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.771180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.771467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.771746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.772119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.772402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.772673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.772945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.784544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.787756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.790374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.790970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.793244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.794086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.794895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.795168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.795448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.797449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.799274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.800873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.801147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.801428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.802442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.804039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.807678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.807959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.808342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.808614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.809034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.810644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.814007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.814297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.814598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.814886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.817440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.817718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.817989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.823801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.824088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.824399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.826255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=109152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.826528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.826822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.827088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.827350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.827712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.827981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.828253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.828533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.828797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.829061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.829316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.829581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.829849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=109152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.832066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=109153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 18:33:27.832343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.832723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.832997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.833268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.833539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.833811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.834085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.834366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.834655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.834924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.835182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.835452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.835722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=109153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 18:33:27.867258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55875519e9c0 pid: 109152 (default app) Oct 18 18:33:27.872166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80e0c-c42b-4323-bbcd-26cfa0fbed8e None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:27.872453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80e0c-c42b-4323-bbcd-26cfa0fbed8e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:27.872726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80e0c-c42b-4323-bbcd-26cfa0fbed8e None None] PATH_INFO: `/v3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:27.874121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55875519e9c0 pid: 109153 (default app) Oct 18 18:33:27.876931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Mon Oct 18 18:33:27 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:35.585073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:35.585614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:35.585614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:35.591351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:35 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:33:35.597479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:35.597900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:35.598149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:35.629511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG oslo_db.sqlalchemy.engines [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 18:33:35.818163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG passlib.handlers.bcrypt [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=109152) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 18:33:35.818592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG passlib.handlers.bcrypt [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=109152) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 18:33:35.874956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:35.876790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:36.011091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:36.152601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:36.184883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG oslo_db.sqlalchemy.engines [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 18:33:36.314395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421b2c-f335-4bbc-93cb-ebfcbad6cd23 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:36.318647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:36.319298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:36.319573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:36.319840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:36.327775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:36.378908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 18:33:36.379237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43f55f-4bec-4d73-b758-36222ca21255 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:36.389355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:33:36.396949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:36.412569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14941-a0bd-48f8-82e0-8579559689d2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:36.421775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:36.422891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:36.423172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:36.423545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:36.424949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fba8b4340c45198a97460c74be901e)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:36.474736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 18:33:36.475079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff49df-fd6b-4e3c-86d4-ce2601e2a20b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:36.480501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:36 2021] GET /identity/v3/projects/e2fba8b4340c45198a97460c74be901e => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:38.718853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc0cb-8036-47de-a966-5f14c14d6b1b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:38.719457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc0cb-8036-47de-a966-5f14c14d6b1b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:38.719457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc0cb-8036-47de-a966-5f14c14d6b1b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:38.723923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:33:38.730001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:38.730387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:38.730564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:38.750804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:38.752311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:38.760919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:38.783777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc0cb-8036-47de-a966-5f14c14d6b1b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:38.795827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc0cb-8036-47de-a966-5f14c14d6b1b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:38.800043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:38.800673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:38.800956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:38.801229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:38.809473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:38.811275 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d4660-d43f-457b-9c1b-6ed6f7d3a1cb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:38.820067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:33:38.827186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:38.836076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e1767-4a15-4aa9-9c6e-fec342803e5d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:38.840471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:38.841322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:38.841605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:38.841881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:38.843296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:38.845131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c922-bf7c-4886-928c-876c4f5a1c01 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:38.846700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:38 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:41.146610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097115-8f07-487f-98c5-4f2e0b31d849 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.147123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097115-8f07-487f-98c5-4f2e0b31d849 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.147196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097115-8f07-487f-98c5-4f2e0b31d849 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.148892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:41.155384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112979d3-7786-45aa-83f1-cc1a1b9ec3bc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.155829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112979d3-7786-45aa-83f1-cc1a1b9ec3bc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.155938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112979d3-7786-45aa-83f1-cc1a1b9ec3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.173738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-112979d3-7786-45aa-83f1-cc1a1b9ec3bc None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:41.175014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-112979d3-7786-45aa-83f1-cc1a1b9ec3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:41.183131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:41.208427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097115-8f07-487f-98c5-4f2e0b31d849 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.209423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658253-4cc4-466a-9797-8b054e8e61a8 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.209715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658253-4cc4-466a-9797-8b054e8e61a8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.209994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658253-4cc4-466a-9797-8b054e8e61a8 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.212371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 7/12] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:33:41.217932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.218455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.218763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.221555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097115-8f07-487f-98c5-4f2e0b31d849 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.225750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.226521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.227058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.227334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.236423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:41.237635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:41.242891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:41.246587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:41.249739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:33:41.250967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 6/14] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:41.257197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.267203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c90f-c4f8-4577-8581-ad30026db783 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.269301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.271917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.272567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.272844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.273117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.273876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:41.274179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.276523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:41.276523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:41.276523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:41.277426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.279438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59974251-f34b-4c00-975f-6118568ff68b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.283761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.284381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.284663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.284939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.292776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 9/15] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:41.293323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.295134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.298456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.303926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:33:41.308105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd668748-215b-4f89-a671-22b615b82d7b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.309885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.312843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.313691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.313959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.314234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.315705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.317535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.318068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597fd8a-1ece-41ad-b61a-d77897b15578 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.322944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.323689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.323968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.324238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.324737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 10/17] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:41.325859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.325969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.327770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.329532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 8/18] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:41.335707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d28f3-ffad-4fd7-b3e0-b409dff1cb2a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.340547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.341370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.341656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.341936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.343260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.345054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a555493-387b-4af5-a67d-3173c54b2458 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.347023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 11/19] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:41.354240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:41.364378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336ed71-c2ed-4b82-866b-ce5d18811bf7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:41.369526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:41.370197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:41.370479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:41.370786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:41.371653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.domain.id=default, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:41.371960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:41.373760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:41.373760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:33:41.373760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:33:41.374975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dfbbe-2258-4757-bb1a-d765beab8069 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:41.384775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 9/20] 10.222.0.36 () {56 vars in 1343 bytes} [Mon Oct 18 18:33:41 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.domain.id=default&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:44.202107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222991c3-4203-40b2-9e10-5e03c7a4192f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.202685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222991c3-4203-40b2-9e10-5e03c7a4192f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.202685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222991c3-4203-40b2-9e10-5e03c7a4192f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.204523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 12/21] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:44.211106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.211608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.211709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.260751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG passlib.handlers.bcrypt [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=109153) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 18:33:44.261111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG passlib.handlers.bcrypt [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=109153) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 18:33:44.323660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:44.325296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-38ccf16f-d0f9-4eb2-9bed-216c0eea485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:44.356428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 10/22] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:44.375148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0fd5d-4d41-4325-a375-3ca79be876a2 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.375764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0fd5d-4d41-4325-a375-3ca79be876a2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.376246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0fd5d-4d41-4325-a375-3ca79be876a2 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.378451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 13/23] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:44.385122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.385417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.385952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.395376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0fd5d-4d41-4325-a375-3ca79be876a2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.418661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:44.418661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:44.419984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0fd5d-4d41-4325-a375-3ca79be876a2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.425770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.426830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.427411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.427924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.428848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:44.444478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.446725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.468242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.469291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:33:44.470833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 14/25] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:33:44.476655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.485326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed2051-ce42-4b05-8847-786d2ac88bb9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.490743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.491849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.492342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.492520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba25657-f632-4e1c-88c5-da1e9044742a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.492988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.502428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.503122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.503402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.503674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.504426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:44.504729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.505983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:44.505983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:44.505983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:44.507170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.516269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:44.527485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:33:44.529043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 12/26] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:44.535071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 15/27] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:44.535630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.541327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.546954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac39c64-005f-4771-bde7-71ce042956a4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.555852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d178f-ca57-4612-af04-cfd0d2097437 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.561273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.561930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.562209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.562485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.562798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.563238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.563930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.564247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:44.564247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:44.564247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:44.564924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.565402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.565500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5fdb4-e4de-4cc7-83f2-e17f64b4eb8e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.566491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:44.567025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.568408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:44.568408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:33:44.568408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:33:44.569708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.583549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 13/28] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:44.590571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.601889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5983d5c-243e-4ba4-befa-9dc9df8b001c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.613296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.614577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.615071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.615595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.621260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.623687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.626269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 14/29] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:44.632380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.643759 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689f43-ba5e-4767-94e1-6f4cb00d0023 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.654047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.655162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.655676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.656158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.663291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.665415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.667654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 15/30] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:44.673694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:44.688634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02f3f-6904-4719-9352-e478f9628c79 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:44.703425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:44.704696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:44.705235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:44.705719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] PATH_INFO: `/v3/domains/default/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:44.708168 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ccbaff1ca24443ce904c9dbb2942c081, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:44.709487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:44.709487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:33:44.709487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:33:44.711936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21d80d-2f6d-4b24-94a9-e837a6265400 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:44.730533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 16/31] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:33:44 2021] POST /identity/v3/projects => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:33:44.858860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 16/32] 10.222.0.36 () {58 vars in 1382 bytes} [Mon Oct 18 18:33:44 2021] PUT /identity/v3/domains/default/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:33:45.013762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf9f4-e9ce-4010-b4e0-5279c8a7c7b3 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:45.014429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf9f4-e9ce-4010-b4e0-5279c8a7c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:45.014944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf9f4-e9ce-4010-b4e0-5279c8a7c7b3 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:45.017381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:45.024100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5a37d-42d8-42d2-bce9-c65e333673e4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:45.024724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5a37d-42d8-42d2-bce9-c65e333673e4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:45.025290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5a37d-42d8-42d2-bce9-c65e333673e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:45.055866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f7f5a37d-42d8-42d2-bce9-c65e333673e4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:45.058058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f7f5a37d-42d8-42d2-bce9-c65e333673e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:45.155444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 17/34] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:45.197821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf9f4-e9ce-4010-b4e0-5279c8a7c7b3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:45.216291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf9f4-e9ce-4010-b4e0-5279c8a7c7b3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:45.221736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:45.222716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:45.223238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:45.223785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:45.224823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:45.226246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:45.226246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:45.226246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:45.227603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0d585-b32b-4305-aa6c-be761276fc9e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:45.250636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 18/35] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:33:45 2021] POST /identity/v3/roles => generated 219 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:33:46.020408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2829e-cdb7-4196-94d3-f0a445144dd7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.021382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2829e-cdb7-4196-94d3-f0a445144dd7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.021896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2829e-cdb7-4196-94d3-f0a445144dd7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.027208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:46.033431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93698a-a95b-4f92-a1b1-a607e38d6e0f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.033984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93698a-a95b-4f92-a1b1-a607e38d6e0f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.034473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93698a-a95b-4f92-a1b1-a607e38d6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.053946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ad93698a-a95b-4f92-a1b1-a607e38d6e0f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:46.055886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ad93698a-a95b-4f92-a1b1-a607e38d6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:46.064610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:46.090163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2829e-cdb7-4196-94d3-f0a445144dd7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:46.102060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed56b-5789-46c6-b8f3-b6905d171602 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.102707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed56b-5789-46c6-b8f3-b6905d171602 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.103284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed56b-5789-46c6-b8f3-b6905d171602 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.105268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 20/38] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:33:46.107063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2829e-cdb7-4196-94d3-f0a445144dd7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:46.111412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.111985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.112489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.115240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:46.116047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.116340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.116624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.117967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:46.120479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:46.122316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 19/39] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:46.129761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:46.141493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ba77-4dc2-4028-9182-59a8b86ad297 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:46.145745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:46.146999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:46.147299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:46.148268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.148801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.149318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.150820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:46.152217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:46.152217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:33:46.152217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:33:46.154173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62566e7-d927-436e-8959-2b6643a3babe admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:46.164822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:46.190286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:46.191460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/projects => generated 312 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:33:46.200075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66f6ad-08c3-467b-9191-a09936412a05 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:46.262476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:46.263151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.263433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.263629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.264411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:46.266104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fac2a-1752-461b-87de-711b3ec5e8fc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:46.286675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/roles => generated 225 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:33:46.803450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b4b-0f8f-4383-984a-38cc166f4718 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.804143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b4b-0f8f-4383-984a-38cc166f4718 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.804641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b4b-0f8f-4383-984a-38cc166f4718 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.807475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 21/43] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:46.813271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f2af-16d2-4125-bf84-f05c5c9282c3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.813504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f2af-16d2-4125-bf84-f05c5c9282c3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.813735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f2af-16d2-4125-bf84-f05c5c9282c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.832283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b672f2af-16d2-4125-bf84-f05c5c9282c3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:46.833491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b672f2af-16d2-4125-bf84-f05c5c9282c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:46.841684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 23/44] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:46.864951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec52b4b-0f8f-4383-984a-38cc166f4718 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:46.877998 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec52b4b-0f8f-4383-984a-38cc166f4718 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:46.882379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:46.883119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:46.883408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:46.883688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:46.884557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:46.886319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:46.886319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:33:46.886319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:33:46.887297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001102e-4251-4f8d-931a-29e3fae929f6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:46.904382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:33:46 2021] POST /identity/v3/roles => generated 223 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:33:47.824299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029997-5f79-4d91-9db1-421c6608d317 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:47.824815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029997-5f79-4d91-9db1-421c6608d317 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:47.824920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029997-5f79-4d91-9db1-421c6608d317 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:47.826717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 24/46] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:47.832828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:47.833257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:47.833479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:47.853215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:47.854423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:47.862291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 23/47] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:47.892352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91029997-5f79-4d91-9db1-421c6608d317 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:47.905082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91029997-5f79-4d91-9db1-421c6608d317 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:47.910324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:47.911318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:47.911607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:47.911885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:47.924945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:47.932015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:33:47.934163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:33:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:47.940658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:47.953021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9ab5-24ef-4e94-a69f-1bb2f6a35e34 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:47.957389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:47.958039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:47.958319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:47.958615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:47.959384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:47.959697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:47.961308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:47.973438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 24/49] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:47.979594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:47.993139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fb482-527d-4384-a96f-070fa5c2402a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:47.997558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:47.998412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:47.998723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:47.999013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.000203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:48.002444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:48.004251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 26/50] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:47 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:48.014076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:48.023633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f19219-b869-4953-8f91-68a55c57c2ac admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:48.028611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:48.029393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.029674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.029948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.031146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:48.032850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71849c28-4787-4852-a99c-1e760b96336e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:48.034608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 25/51] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:48.040717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:48.050625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f819-97c9-4602-b4be-bdd958732ffe admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:48.054997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:48.055664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.055947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.056249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.057085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.domain.id=default, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:48.057395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:48.058394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:48.058394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:48.058394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:48.059599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68611-83c3-4d02-817a-cc10fbbccbff admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:48.066919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 27/52] 10.222.0.36 () {56 vars in 1343 bytes} [Mon Oct 18 18:33:48 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.domain.id=default&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:48.778808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c786-903f-46ce-a77c-c61b85c97982 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.779101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c786-903f-46ce-a77c-c61b85c97982 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.779380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c786-903f-46ce-a77c-c61b85c97982 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.781157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 26/53] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:48.788989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.789280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.789562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.806881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:48.808072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:48.815497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 28/54] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:48.840558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773c786-903f-46ce-a77c-c61b85c97982 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:48.852391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773c786-903f-46ce-a77c-c61b85c97982 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:48.856612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:48.857368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.857647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.857923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.859112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:48.860799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e743b-d083-432c-9bcc-3a4dfbfac069 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:48.862332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:48.868287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:48.877440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022becf-3cd4-439f-b111-44782e09fa1b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:48.882020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:48.882732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:48.883015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:48.883312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:48.884051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:48.886948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7e921-2dc9-4f36-82dc-27a6ba784abd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:48.912173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 29/56] 10.222.0.36 () {60 vars in 1161 bytes} [Mon Oct 18 18:33:48 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:33:51.133472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567273-45c5-4370-9dc4-bf65eca799ab None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:51.134007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567273-45c5-4370-9dc4-bf65eca799ab None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:51.134007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567273-45c5-4370-9dc4-bf65eca799ab None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:51.136600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 28/57] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:51.142241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:51.142631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:51.142830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:51.160582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:51.161774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:51.215404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 30/58] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:51.239886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12567273-45c5-4370-9dc4-bf65eca799ab None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:51.251514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12567273-45c5-4370-9dc4-bf65eca799ab None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:51.255564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:51.256317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:51.256595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:51.256870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:51.258024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:51.260295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76019ad-b82f-4251-9b2d-b9678bf89669 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:51.262072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:51.267593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:51.276641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda6fa-23df-444b-b0ca-314ce66be223 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:51.280953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:51.281587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:51.281863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:51.282133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:51.282887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:51.283883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:51.283883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:51.283883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:51.285096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39a8eb-4b8e-4d3d-a8de-254f6ad9b2b8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:51.309247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 31/60] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:33:51 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:33:54.730459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99cef-91d9-455f-8c47-d1c7e32cccf1 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.731471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99cef-91d9-455f-8c47-d1c7e32cccf1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.731989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99cef-91d9-455f-8c47-d1c7e32cccf1 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.734041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 30/61] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:54.740146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.740973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.741454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.765047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:54.766622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:54.781303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 32/62] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:54.822754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762334-6fe3-4b9d-b39d-b19dca710318 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.823365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762334-6fe3-4b9d-b39d-b19dca710318 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.824051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762334-6fe3-4b9d-b39d-b19dca710318 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.825063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:54.826607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:54.832504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.833053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.833523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.834379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cecce-3de7-4258-9a2a-72ef94489f91 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:54.843421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:54.844225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.844509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.844787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.853469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:54.854968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:54.861797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:54.863130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 32/64] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:54.868783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:33:54.870130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 33/65] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:33:54.878997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:54.892492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5f43-7c03-4917-9bab-bf135049e511 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:54.904733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:54.904907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:54.905909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.906409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.906897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.907856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:54.908371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:54.910178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:54.920295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 33/66] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:54.920551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32aeac-61de-4ef4-b7c3-71caf9afbba0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:54.925203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:54.926630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:54.927807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.928659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.930290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.937966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc25-6667-45f4-8f2b-15928f9dda0a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:54.941663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:54.942855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:54.943808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.944189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.944663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.949977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ffe5dd66-1a39-40ed-8bcb-fd0d3ec60f99 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:33:54.951669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:54.953132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70435c2-3755-4fb8-8a36-401eb405eb4a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.953635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70435c2-3755-4fb8-8a36-401eb405eb4a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.954329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70435c2-3755-4fb8-8a36-401eb405eb4a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.956239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 35/68] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:54.962430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.962985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.963461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.965665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:54.967887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:54.970857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:54.971635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:54.981997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2e503-c69c-4ed5-911b-1b88e6dd97da admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:54.984120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:54.985397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:54.988908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:54.989746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:54.990188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:54.990560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:54.991579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:54.991983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:54.993765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:54.995654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 36/70] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:55.003127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.003766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.009607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.018596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a009-eede-438e-8802-6ed6e170ab09 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.019365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c91-1750-4409-8a8c-9588d8d6293b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.031164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.032038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.032332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.032648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.033990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.036176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.036750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.037635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.037768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 36/72] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.038376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.038781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.042988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.051567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.053597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.055261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9545-c425-4457-92e3-7ec7cad22ea3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.060307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.061396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.061879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.062349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.065041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 37/73] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:33:55.066058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.074584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:55.076281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3165da-901a-4f5e-8568-149fe50dbd9f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.081098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.081501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:33:55.082181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.082827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.082959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 37/74] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:55.083377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.084045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.098241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.099254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e6b4-16aa-4b44-81b9-a2a2e3df56d1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.100553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.105073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.106228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.106732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.107218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.109095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.111487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.113052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:33:55.114136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.119036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 38/76] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.120431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.124925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005688-e062-4c17-b91a-a0ee846ed017 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.129786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.130832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.131136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e973a6a-5e24-41e9-97b2-9a64b47157e4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.131449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.131830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.133034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.133558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.136016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.137029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.138048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.138471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.138914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.140323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.142524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.144736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 39/77] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.146633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.146750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 39/78] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.153465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.162287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710933e-5968-487e-ae35-29fa0a5309d3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.163244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553aa67-b727-4dad-a804-501d5bd63ea2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.167139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.167876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.168232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.168358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.168706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.169087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.169371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.169649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.169907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.170311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.170886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.172390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.172697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.174308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:55.178633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 40/80] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.179929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.182521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.192244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efa06c-4dbc-45df-bf74-b9ee3489d2b5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.193307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55973-4937-494c-8a97-b81c4613336f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.197690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.198368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.198684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.198961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.199543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.200020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.200340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.200839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.201315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.201798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.202261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.209207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=ee902deb77954618a3800ef701089e61 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.211664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.214104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.224237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:33:55.230889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.241270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a8d3-305c-469a-978f-cfb75700e15b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.246502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.247409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.247690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.247965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.249246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.251451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcecda-0d38-4765-bec5-f9223f079d40 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.253235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.259982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.269671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db9a0a-8dee-467a-a45b-574620b520ff admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.274495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.275818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.276101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.276376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.277236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.277547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.279483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016b948-2660-431a-9bfa-8c91aa3b4b90 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.285949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 42/84] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.291024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300be1-cebd-4477-8513-8e147aae48f7 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.291323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300be1-cebd-4477-8513-8e147aae48f7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.291576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300be1-cebd-4477-8513-8e147aae48f7 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.293684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 43/85] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:55.300161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b9735-2a4e-4a41-a274-4deb70e8b5b6 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.300472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b9735-2a4e-4a41-a274-4deb70e8b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.300721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b9735-2a4e-4a41-a274-4deb70e8b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.325351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bd7b9735-2a4e-4a41-a274-4deb70e8b5b6 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:55.326978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bd7b9735-2a4e-4a41-a274-4deb70e8b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:55.345196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf322a-3c5d-455a-8e8a-0d01f74cfe64 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.345934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf322a-3c5d-455a-8e8a-0d01f74cfe64 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.346412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf322a-3c5d-455a-8e8a-0d01f74cfe64 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.347925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:55.349132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 44/87] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:55.356017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.356316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.356581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.378508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf322a-3c5d-455a-8e8a-0d01f74cfe64 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.381124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:55.389471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:55.403694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf322a-3c5d-455a-8e8a-0d01f74cfe64 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.408277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:55.412037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.413248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.413766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.414234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.433335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.445064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad6af-1f5a-4119-90f4-383c14a7695a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.451338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:55.454818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.458101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.459035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.459676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.463405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.467448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.470430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 45/89] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:55.471640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:33:55.473399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 45/90] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:55.479763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.485872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.492789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef695-5654-4e7b-9483-b3151d6158de admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.499785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b160f7-8fde-4b2f-a0e9-30052f791668 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.502382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.503412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.503958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.504428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.505420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.507921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.516371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.517061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.517345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.517781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.518419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.518891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.520589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.547053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 46/91] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:55.548958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.557577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 46/92] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:33:55 2021] POST /identity/v3/projects => generated 302 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:33:55.562738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c76035-3bba-4565-baba-2398979172e0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.624297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.625181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.625463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.625737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.627093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.629293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.631374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 47/93] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.638131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.654289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da057-ab35-45c7-a533-0641f456276b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.659256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.660218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.660744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.661288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.671398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.673720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.684264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 47/94] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:33:55.690243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.707871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a076-29ae-4043-999c-22a4b71878f0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.723417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.724302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.724588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.724860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] PATH_INFO: `/v3/projects/0023ad842dbd4c2798ddbea86a7268fd` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.726169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] RBAC: Authorizing `identity:get_project(project_id=0023ad842dbd4c2798ddbea86a7268fd)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.728845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e138-8c43-46e7-aee9-a6ccb021615a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.730609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 48/95] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/projects/0023ad842dbd4c2798ddbea86a7268fd => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:55.737282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:55.749005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152499a-9b5d-4835-ae08-f12808055be5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:55.753739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:55.754655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:55.755253 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:55.755724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:55.756866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=0023ad842dbd4c2798ddbea86a7268fd, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:55.757476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:55.766359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ccc5-5402-4bb8-b108-01c13ebd7566 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:55.773374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:33:55 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=0023ad842dbd4c2798ddbea86a7268fd&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.043346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6585de-6b4b-4349-b468-2aaef3fe232c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.043899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6585de-6b4b-4349-b468-2aaef3fe232c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.043899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6585de-6b4b-4349-b468-2aaef3fe232c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.045659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 49/97] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:58.052413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.052887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.052969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.079660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:58.080899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:58.095601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:33:58.124087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c599-968a-4a1e-8588-5b9573f89f0c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.124622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c599-968a-4a1e-8588-5b9573f89f0c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.125061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c599-968a-4a1e-8588-5b9573f89f0c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.127314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 50/99] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:58.128521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.133082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.133553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.134016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.153735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70286c-f794-4e6e-b144-a2e33052dd5c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.161045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:58.162881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:58.170575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.170575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.170575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.170575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.180840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 51/100] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:58.186818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:58.193684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:33:58.195346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 50/101] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:58.203774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.213830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.221940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6aca-638e-469f-9cc7-80bfb3390db4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.227574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9ab9-6f4d-4e7b-b712-b4892881a6c4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.233160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.234480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.235346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.236317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.237023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.238042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.239059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:58.239556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.240030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.240534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.243168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.259871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 52/102] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.263431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:58.266351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.272428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-00924017-6e76-47e0-8741-15b0cb8d8b56 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:33:58.273892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:58.275860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f533-95dd-46c2-80b7-addadc37b729 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.276398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f533-95dd-46c2-80b7-addadc37b729 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.276881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f533-95dd-46c2-80b7-addadc37b729 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.278768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 52/104] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:58.283229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f6d4-193c-4b07-80ee-d4b9aca67035 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.284309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f533-95dd-46c2-80b7-addadc37b729 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.295415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.296568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.297056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.297543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.298999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.301015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f533-95dd-46c2-80b7-addadc37b729 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.301609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88a907-1967-4772-b90a-f236159e7568 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.303457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 53/105] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:58.304848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.305343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.305832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.306479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.307172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.307457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.310848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.311844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:58.312360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.314141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.323186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 53/106] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.324231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.334568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:58.334568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:58.338852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:58.339651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.342680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a929a-8cbe-4e69-854f-7d3275ed7550 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.350159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.351270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.351393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.351744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.353284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.355308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c1b7-0977-44a1-85a5-7956998edd64 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.357076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 54/108] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.357199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210f249-0d9c-4e14-8ac1-a221992273f9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.362584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a24df-4307-4c07-8038-e1b9b8fd5b52 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.362584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a24df-4307-4c07-8038-e1b9b8fd5b52 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.362584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a24df-4307-4c07-8038-e1b9b8fd5b52 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.362584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 55/109] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:58.365189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a24df-4307-4c07-8038-e1b9b8fd5b52 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.367274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.368114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.368934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.369207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.370439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.372622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.374354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 55/110] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.375172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.382934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a24df-4307-4c07-8038-e1b9b8fd5b52 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.385194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcff5-7f2d-462d-8eb6-4a4ae8ff82ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.388884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.389816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.390289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.390580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.390868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.391070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.391191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.391686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/b0ebbc65a9e348b581a267a279422b57/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.394333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba932071ba8140599ec7bb20c2d16789, user_id=b0ebbc65a9e348b581a267a279422b57, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.397838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.401470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:58.408751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-1255dcee-7b83-49e0-821b-e6b95910fa23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:33:58.415204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:58.415204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.415204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.415204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.417825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:33:58 2021] PUT /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/b0ebbc65a9e348b581a267a279422b57/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:33:58.418478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.445922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:58.448764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:58.494718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924b30-b4f9-4f40-a03a-bd7fde4512b4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.500486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.501364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.501650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.501930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.503931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.506580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.510731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 57/113] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.511871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.523975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d48e7-a91e-4b56-9776-19fdbc4f48e9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.529710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.531251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.531770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.532336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.532779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 57/114] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:58.533872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:58.534436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.536384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.539665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.548090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.553147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78c01-ff49-4ed8-b7e4-17326871a7a9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.555815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.565657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.566649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.566914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.567189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/b0ebbc65a9e348b581a267a279422b57/roles/ee902deb77954618a3800ef701089e61` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.569930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74159b-e4fe-430d-ae47-81071470f484 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.572689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba932071ba8140599ec7bb20c2d16789, user_id=b0ebbc65a9e348b581a267a279422b57, role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.573742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:33:58.573742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:33:58.573742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:33:58.575826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.576354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.577600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.578107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.578705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.580385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.582560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.585316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 59/116] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.591690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.600320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 58/117] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:33:58 2021] PUT /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/b0ebbc65a9e348b581a267a279422b57/roles/ee902deb77954618a3800ef701089e61 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:33:58.603644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a13811-31c4-413d-bd33-837651976021 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.607359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.692404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.693225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.693406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5115-a0ef-4dab-821d-ac5b1874efff admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.693517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.693771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.698609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.699508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.699851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.700131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.701517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.703714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f5c5-5b43-41fe-bee0-8b8df7575833 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.705887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.707285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf944c2f-156c-4815-abba-77a285a7713a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.707570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf944c2f-156c-4815-abba-77a285a7713a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.707774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:33:58.707870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf944c2f-156c-4815-abba-77a285a7713a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.709949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 60/119] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:33:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:33:58.713547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf944c2f-156c-4815-abba-77a285a7713a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.715461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f9586480-4722-401a-abb5-72d4cff11270 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:33:58.716973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:33:58.718298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.718615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.718902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.734086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf944c2f-156c-4815-abba-77a285a7713a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.739033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.739411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:33:58.739940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.740315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.740601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.740711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:33:58.742913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba932071ba8140599ec7bb20c2d16789, user_id=ccbaff1ca24443ce904c9dbb2942c081, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.745939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.749221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:33:58.755605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.762797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 61/122] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:33:58 2021] PUT /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:33:58.768378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ffa0b-ab0e-4646-9144-7e5355654d83 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.784347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.864134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b003a00-9db5-41c5-85f1-d0f083a64c16 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.874242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.875093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.875378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.875715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.877116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.879158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.879888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.880515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.880798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.880912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.881088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.881854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:33:58.882159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.884981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.891334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.894076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 62/124] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:33:58.901759 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.903383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c60d-9d1c-4473-91fb-21701c32ec1e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.909017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.910222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.910690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.911265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.912179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.913289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db138-7fe0-4ad2-872b-8fb9ad9c4e0d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.914509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.918312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.919317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.919603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.919880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.922107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.924474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.926344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:58.934692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.943250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 63/126] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:33:58 2021] POST /identity/v3/users => generated 283 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:33:58.945798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b42082-2e61-4e3b-b436-c30244107fde admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.951048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.952982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.952982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.952982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] PATH_INFO: `/v3/projects/0023ad842dbd4c2798ddbea86a7268fd` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.954631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0023ad842dbd4c2798ddbea86a7268fd)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.956204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12298530-3b47-4c98-96f6-37a7b1945fa0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:58.958131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:33:58 2021] GET /identity/v3/projects/0023ad842dbd4c2798ddbea86a7268fd => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:33:58.964608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:33:58.974923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7c1e-68e1-422d-addf-50a34ebbd876 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:33:58.981547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:33:58.982579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:33:58.982917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:33:58.983260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] PATH_INFO: `/v3/projects/0023ad842dbd4c2798ddbea86a7268fd/users/b0ebbc65a9e348b581a267a279422b57/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:33:58.985593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0023ad842dbd4c2798ddbea86a7268fd, user_id=b0ebbc65a9e348b581a267a279422b57, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:33:58.988712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753cd1-445a-485c-bcd3-f9b9e3ec1c8b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:33:59.007490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 64/128] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:33:58 2021] PUT /identity/v3/projects/0023ad842dbd4c2798ddbea86a7268fd/users/b0ebbc65a9e348b581a267a279422b57/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:01.381255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703e5a-b23e-4597-bcaf-ef857fdeebd7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.381768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703e5a-b23e-4597-bcaf-ef857fdeebd7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.381842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703e5a-b23e-4597-bcaf-ef857fdeebd7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.383962 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 65/129] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:01.390684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.391149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.391225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.415831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:01.417061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:01.482116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:01.527080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d703e5a-b23e-4597-bcaf-ef857fdeebd7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.543406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d703e5a-b23e-4597-bcaf-ef857fdeebd7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.548276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.549093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.549500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.549785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.567424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:01.576565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:01.577841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:01.584632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.594451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be5cb-4e7c-4fac-9849-91403c16d05c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.602248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.602990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.603278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.603554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.604411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:01.604716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.606331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.617832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:01.624215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.640444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382959-a84e-4f95-a2a9-9249a642aa1f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.645186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.646090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.646376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.646675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.647894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.650151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.651814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 67/133] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:01.658099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.671621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d124b-6230-4b9b-a5b2-7e836883e5d3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.676219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.676862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.677147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.677426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.690192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.692056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7170b6-9ac3-4ccf-8ef0-f46c3506ad82 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.703943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:01.710734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.723557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b548b9-7bea-4e43-be90-3191442e3dec admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.733078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637278a-3f95-44dc-9fb7-3040981f1ffe None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.733368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637278a-3f95-44dc-9fb7-3040981f1ffe None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.733649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637278a-3f95-44dc-9fb7-3040981f1ffe None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.735455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 68/135] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:01.736050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.736895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.737177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.737455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.738726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.740820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.742741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.743025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.743331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.752035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:01.758337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.771349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a35a5-0305-4452-92c2-884dec41f3a0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.775723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:01.777273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:01.779703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.780358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.780639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.780913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.781758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:01.782066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.784007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.787867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:01.792585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 69/138] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=ee902deb77954618a3800ef701089e61 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:01.837927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.852131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b063-416a-4816-b38a-5ea3c2a2d137 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.861043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.861858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.862141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.862414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.884945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:01.894803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:01.896179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 70/139] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:01.903495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.919862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a84fa-120e-47b7-8c87-54806b485ecf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.931851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.932528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.932808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.933079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.933923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:01.934225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.935905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.950294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 70/140] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:01.956941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:01.971995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5287-8686-468c-bf6a-95d03f46a529 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:01.982736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:01.983643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:01.983928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:01.984207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:01.988564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:01.990874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:01.992863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 71/141] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:01.999898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.016004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b2a1-d77b-4459-b30d-67326652fa65 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.027373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.028030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.028314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.028589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.039724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.041692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.056803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:02.063149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.075386 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaa520-d8f2-4cee-b25f-946631b710a0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.086365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.087853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.088137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.088416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.095357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.097460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0ce06-a3a8-42d0-b53f-19eef3d9620e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.099398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 72/143] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.106232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.120457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d147-8b25-49ff-9c96-dc49fe67fb77 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.127800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.128530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.128810 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.129081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.130038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:02.130349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.132298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372293f-2567-4590-a58d-a44de87f8534 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.143966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 72/144] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.251578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62413c-6aed-4f03-83e6-e26deb04d185 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.251869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62413c-6aed-4f03-83e6-e26deb04d185 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.252056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62413c-6aed-4f03-83e6-e26deb04d185 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.253837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 73/145] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:02.261312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.261630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.261880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.290943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:02.292169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:02.303509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:02.355797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62413c-6aed-4f03-83e6-e26deb04d185 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.380663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62413c-6aed-4f03-83e6-e26deb04d185 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.388918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.389723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.390008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.390284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.405183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:02.412143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:02.413712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 74/147] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:02.420753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.435417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7041b-e877-4aae-9b67-1198280a3d86 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.443985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.444718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.445009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.445337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.446112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:02.447032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.448708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.465491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 74/148] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.471947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.488282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3057fc-7cf4-4fa3-baaf-56c223394bd9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.497668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.498565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.498849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.499127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.503335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.505158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.507084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 75/149] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.514199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.528300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725bdf-0749-4c93-adda-899599c8f2f1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.537106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.537844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.538132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.538410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.551118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.552961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.569232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:02.576325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.593827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0aeec-17fb-4211-92ea-5a6007c415e3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.602204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.603154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.603435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.603706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.607347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.609444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdef51e-25e8-48a2-9648-514b970c7b8c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.611526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 76/151] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.618123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.630940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82bda-cf9c-4d63-be4f-bb113c72c910 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.639127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.639835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.640116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.640458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.641357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=ba932071ba8140599ec7bb20c2d16789, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:02.641669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:02.643678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612fbc0-7d2a-4aea-8c3d-adfc91b06c8d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:02.655915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 76/152] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:02.865222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff03-ed82-46ae-b940-11327d7f9704 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.865610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff03-ed82-46ae-b940-11327d7f9704 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.865785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff03-ed82-46ae-b940-11327d7f9704 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.867922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 77/153] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:02.875849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918447-7467-443e-9099-d037077c00d4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.876128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918447-7467-443e-9099-d037077c00d4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.876405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918447-7467-443e-9099-d037077c00d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:02.900397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-7b918447-7467-443e-9099-d037077c00d4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:02.901679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7b918447-7467-443e-9099-d037077c00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:02.910125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 77/154] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:02.951450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dff03-ed82-46ae-b940-11327d7f9704 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:02.968852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dff03-ed82-46ae-b940-11327d7f9704 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:02.978875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:02.979684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:02.979961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:02.980230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.002557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:03.009981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:03.011475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 78/155] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:03.018333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918447-7467-443e-9099-d037077c00d4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.032188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918447-7467-443e-9099-d037077c00d4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.040527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.041313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.041593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.041918 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.042784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:03.043093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.044825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.062647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.069490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.083854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bdbfb-d0d9-4641-871f-58ec26c4a285 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.090803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.091686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.091968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.092253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.099469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.101639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.104104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 79/157] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.110535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.123707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82801bb6-8aeb-49ed-b7db-ca351e2d70c1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.130404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.131228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.131515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.131873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.145066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.147186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.162684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:03.169040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.182039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026dc5-fc7a-4250-87da-dab59484d402 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.190205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.191124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.191407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.191688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] PATH_INFO: `/v3/projects/0023ad842dbd4c2798ddbea86a7268fd` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.199346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] RBAC: Authorizing `identity:get_project(project_id=0023ad842dbd4c2798ddbea86a7268fd)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.201418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137a725-2d18-412d-8a81-33398988e8ee admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.203323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 80/159] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/projects/0023ad842dbd4c2798ddbea86a7268fd => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.209917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.223977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3acf19-4fbb-4947-8406-e15b6e02054e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.229870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.230585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.230920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.231196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.232084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=0023ad842dbd4c2798ddbea86a7268fd, user.id=b0ebbc65a9e348b581a267a279422b57) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:03.232396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.234355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a65e-a55f-4794-80eb-179da5a09541 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.243826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 80/160] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/role_assignments?user.id=b0ebbc65a9e348b581a267a279422b57&scope.project.id=0023ad842dbd4c2798ddbea86a7268fd&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.581300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91908361-0875-4f23-b95d-687ef3d47c26 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.581810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91908361-0875-4f23-b95d-687ef3d47c26 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.581884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91908361-0875-4f23-b95d-687ef3d47c26 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.583657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 81/161] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:03.590537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.591001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.591182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.614961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:03.616153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:03.625084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 81/162] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:03.650943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91908361-0875-4f23-b95d-687ef3d47c26 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.666356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91908361-0875-4f23-b95d-687ef3d47c26 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.673422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.674211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.674491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.674795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.687211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:03.694005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:03.697006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 82/163] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:03.702475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.712724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dd806-9951-4d82-9b0b-26f1d3f2ce4c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.719600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.720326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.720646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.720923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.721690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:03.721995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.723636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.736000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 82/164] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.741987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.755403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b18-9dc1-4c7f-bc36-2e541408fc04 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.760994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.762178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.762713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.763185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.777510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.780131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.782378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 83/165] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.788854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.798815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cbcad-1aaf-456c-88fb-ec3ddce8e28a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.803391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.804259 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.804729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.805229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.813441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.815497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.830123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 83/166] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:03.832125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.842241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db7e4-6eaa-411a-9d17-b60acbd52626 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.846918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.848029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.848541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.849004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.850452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.853480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176176f-7d57-4b29-83ac-06fd720f9975 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.860839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 84/167] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:03.862361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:03.872330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb843-dabc-4309-8f70-f11d78e12e33 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:03.877121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:03.878040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:03.878585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:03.879051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:03.880234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=41f11753c1114966bbbe3e9c7e01675b) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:03.880731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:03.882920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24b879-6424-41d9-94fe-7d58d5001623 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:03.889311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:03 2021] GET /identity/v3/role_assignments?user.id=41f11753c1114966bbbe3e9c7e01675b&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.324515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb060-c000-4b09-87a8-b9698f1969df None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.324887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb060-c000-4b09-87a8-b9698f1969df None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.325074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb060-c000-4b09-87a8-b9698f1969df None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.327062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 85/169] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:04.332688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eab91-8c73-41da-91e7-5512d42022c7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.332986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eab91-8c73-41da-91e7-5512d42022c7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.333263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eab91-8c73-41da-91e7-5512d42022c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.351295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9a2eab91-8c73-41da-91e7-5512d42022c7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:04.352493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9a2eab91-8c73-41da-91e7-5512d42022c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:04.360435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 85/170] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:04.376288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c567d6-c709-427e-bc00-a69f81d1ea16 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.376562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c567d6-c709-427e-bc00-a69f81d1ea16 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.376837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c567d6-c709-427e-bc00-a69f81d1ea16 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.378615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 86/171] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:04.385208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c567d6-c709-427e-bc00-a69f81d1ea16 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.386814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.387345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.387835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.398092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c567d6-c709-427e-bc00-a69f81d1ea16 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.403025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.403773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.404047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.404314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.407997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:04.409388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:04.415425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:04.418375 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 86/172] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:04.430158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:04.430158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:04.433900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.445458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be498c26-170b-4790-90fb-57e09830c9bf None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.449633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.452672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.453438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.453795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.454141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.455105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:04.455507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.457242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.462111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3010a6-c183-43de-9ce0-4eaaf0c83a58 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.466351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 87/174] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:04.471352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.472021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.472304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.472554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.474170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.486098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a117-eb61-486d-8dc0-204385684dfa admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.487876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:04.490513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.491380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.491660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.491929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.493132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.495850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.497421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 88/175] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:04.497947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:04.499465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 88/176] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:04.503292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.508883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.515578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698529-495b-475c-9ff9-6524034e26ea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.518482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898bc54-4db7-4494-b05c-3585410f0bd5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.521037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.522145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.522807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.523197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.523478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.523958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.524306 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.524674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.525613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:04.525998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.527716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.533179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.535304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.536648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 89/177] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.543209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.546624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 89/178] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:34:04.552778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.553204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958e909-337f-4627-95bc-bdbe3a7640bd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.557764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.558752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.559099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.559456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.560722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.562642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.564209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce737d-495c-452a-81ca-8dcc559a01cb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.564328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 90/179] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.569443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.570112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.570828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.571965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.572383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.573855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.576229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.578102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 90/180] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.582679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df6431-66c3-4668-9be0-a52140a87cbe admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.584362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.587898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05056021-a165-47f9-b928-304172276d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.588586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056021-a165-47f9-b928-304172276d9c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.588867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056021-a165-47f9-b928-304172276d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.589140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056021-a165-47f9-b928-304172276d9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.594956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e957-80eb-40b0-9455-c2ae5c6eac28 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.597365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05056021-a165-47f9-b928-304172276d9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.599148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05056021-a165-47f9-b928-304172276d9c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.599470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.600139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.600423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.600740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.601799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=41f11753c1114966bbbe3e9c7e01675b) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:04.602116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.604575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.608305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 91/181] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:34:04.610584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 91/182] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/role_assignments?user.id=41f11753c1114966bbbe3e9c7e01675b&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=ee902deb77954618a3800ef701089e61 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.614433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3851ca-7eab-49c3-a71d-fdf4432c5290 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.614433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3851ca-7eab-49c3-a71d-fdf4432c5290 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.614433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3851ca-7eab-49c3-a71d-fdf4432c5290 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.614433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 92/183] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:04.616627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.622084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.622408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.622664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.632858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c701-1759-4091-903e-335172a23f8f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.638734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.639607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.639886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.640157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.642155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.644615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.646704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 92/184] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:04.651922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:04.653183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.653804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:04.670711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6a57f-4392-4342-ab67-9e658929a6c9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.670910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 93/185] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:04.678630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.679307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.679630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.679902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.680920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:04.681229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.683219 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.689747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 93/186] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:04.690304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.700806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659ff2e-52d9-499c-9ce3-8ad8c63e1cec None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.706234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.707273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.707621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.707965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.709552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.711605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768b37c-03d9-432e-9584-b12714de0a3e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.713670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 94/187] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:04.720444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:04.731741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2aa1b-2b8a-45df-afb1-97d1e84235be admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:04.738523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:04.739301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:04.739585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:04.739902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] PATH_INFO: `/v3/groups` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:04.740712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:04.741866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:04.741866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:04.741866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:04.743185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c8d4-988c-44c2-b4ad-59fc93a5349c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:04.763773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 94/188] 10.222.0.36 () {60 vars in 1155 bytes} [Mon Oct 18 18:34:04 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:06.197341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c698-130d-4ad4-ace9-758e66bf9fb3 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.197843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c698-130d-4ad4-ace9-758e66bf9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.197914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c698-130d-4ad4-ace9-758e66bf9fb3 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.199852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 95/189] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:06.205876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.206739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.207247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.224714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:06.226173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:06.234397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 95/190] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:06.257651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75c698-130d-4ad4-ace9-758e66bf9fb3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:06.275364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75c698-130d-4ad4-ace9-758e66bf9fb3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:06.279668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:06.280440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.280716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.280987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.291496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:06.298414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:06.299597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:06.306386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:06.315216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f9749-0958-4f67-afe8-16a70ad60422 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:06.319589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:06.320237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.320514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.320785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.321609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:06.321917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:06.323589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:06.332324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 96/192] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:06.338715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:06.348875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785e5cc-67dd-40b0-9815-a9c87adeebf7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:06.353317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:06.354152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.354426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.354721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.355917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:06.358055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:06.359835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 97/193] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:06 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:06.365641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:06.375742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923db91-a6bd-4f6f-9ecf-466dcbeb7ce2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:06.380196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:06.381034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.381314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.381590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.382812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:06.384910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e99a1-9dfd-4a6e-a172-c985bffbd9a4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:06.387091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 97/194] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:06 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:06.393192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:06.403628 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28532f17-68d3-4fae-94ad-a907347e2f3d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:06.408046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:06.408916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.409194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.409467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37/users/41f11753c1114966bbbe3e9c7e01675b/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.411545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179a663c0e248e299c331187a356f37, user_id=41f11753c1114966bbbe3e9c7e01675b, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:06.414174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05bbc-ba82-44d3-9822-0ee44e9efa9e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:06.431147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 98/195] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:06 2021] PUT /identity/v3/projects/4179a663c0e248e299c331187a356f37/users/41f11753c1114966bbbe3e9c7e01675b/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:06.953464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d939-47a4-4e35-b01e-25224a91a82f None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.953858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d939-47a4-4e35-b01e-25224a91a82f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.954026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d939-47a4-4e35-b01e-25224a91a82f None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.955864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 98/196] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:06.961674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:06.962022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:06.962310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:06.981463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:06.982741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:07.002416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f878b2-d553-4549-9faf-e3a26d5e7d62 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.002798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f878b2-d553-4549-9faf-e3a26d5e7d62 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.002966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f878b2-d553-4549-9faf-e3a26d5e7d62 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.004986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 99/197] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:07.012087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.012672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.013153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.031984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:07.033256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:07.061839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 99/198] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:07.085643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.095814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04db90-a9c7-458d-8de5-28217ea80749 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.100538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.101576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.102058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.102636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.103226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 100/199] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:07.114124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:07.118184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.121912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:07.123641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:07.128131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8cbb1-0cab-4403-a532-038ba9b009c3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.130272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.131842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.132805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.133223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.133637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.140537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34376c-dd86-4407-85a2-033fb2f30413 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.144655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:07.144791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.145480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.145762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.146038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.146906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:07.147212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.148805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28fbf7-0115-4f88-b397-77816bbbc0a7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.153158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:07.158027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 101/201] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:07.158469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:07.163779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155d70-5ac0-4b78-a6d7-40a11a99aa0c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.163899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.164087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155d70-5ac0-4b78-a6d7-40a11a99aa0c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.164452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155d70-5ac0-4b78-a6d7-40a11a99aa0c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.166436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 102/203] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:07.171316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155d70-5ac0-4b78-a6d7-40a11a99aa0c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.173568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8831-6a7b-4769-a3ff-294594886277 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.177800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.178332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.178636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.179287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.179658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:07.179961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.182041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde0d4f-fe28-40a6-ae58-84337d13220e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.183757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155d70-5ac0-4b78-a6d7-40a11a99aa0c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.187942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.188790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.189053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.189327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.190523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.192065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 102/204] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:07.192662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.193718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c209c-3190-4771-85df-a20051130a8f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.194196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c209c-3190-4771-85df-a20051130a8f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.194654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c209c-3190-4771-85df-a20051130a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.198696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 103/205] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:07.199793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.211185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fa51c-35b4-4db2-9550-89b22a28116c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.214388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a11c209c-3190-4771-85df-a20051130a8f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:07.215575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a11c209c-3190-4771-85df-a20051130a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:07.216287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.217124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.217502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.217780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.219115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.221082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.223342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 103/206] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:07.223990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c209c-3190-4771-85df-a20051130a8f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.226681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 104/207] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:07.236265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.241917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c209c-3190-4771-85df-a20051130a8f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.245365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa10a6-c127-4da4-b520-c7a9eb314e27 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.246658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.247790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.248229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.248573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.250170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.250843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.251664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.251940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.252204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.252301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.253374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.254240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 104/208] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:07.254945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.255481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.257173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 105/209] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:07.262482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.267494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49d50-5cc9-4b94-bf99-c95841d9cf26 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.271987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.272214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd714b-4598-4528-9f11-a24276c92fcd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.272741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.273015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.273299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.274963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.276614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.277339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.278311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 105/210] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:07.278423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.278992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.283491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.283814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37/users/41f11753c1114966bbbe3e9c7e01675b/roles/ee902deb77954618a3800ef701089e61` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.286098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179a663c0e248e299c331187a356f37, user_id=41f11753c1114966bbbe3e9c7e01675b, role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.288717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456682b-e363-4f86-9caf-43b3e45e2a62 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.288833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.293303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.294170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.294444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.294763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.296763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179a663c0e248e299c331187a356f37, user_id=ccbaff1ca24443ce904c9dbb2942c081, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.299334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8626-7798-4f6e-ac58-3bd21d32e7cd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.301820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 106/211] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:07 2021] PUT /identity/v3/projects/4179a663c0e248e299c331187a356f37/users/41f11753c1114966bbbe3e9c7e01675b/roles/ee902deb77954618a3800ef701089e61 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:07.307630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:07.313541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 106/212] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:07 2021] PUT /identity/v3/projects/4179a663c0e248e299c331187a356f37/users/ccbaff1ca24443ce904c9dbb2942c081/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:07.400162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca68c-279d-47a3-b4f2-97acc80129d6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:07.466403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:07.467444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:07.467896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:07.468399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] PATH_INFO: `/v3/groups` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:07.469281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:07.470513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:07.470513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:07.470513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:07.472173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835502f-fb7b-4c23-bd19-347f1889b74b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:07.506903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 107/213] 10.222.0.36 () {60 vars in 1155 bytes} [Mon Oct 18 18:34:07 2021] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:08.805260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fff8-b39e-4ed8-9deb-817b5af6992a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:08.806310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fff8-b39e-4ed8-9deb-817b5af6992a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:08.806310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fff8-b39e-4ed8-9deb-817b5af6992a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:08.808148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 107/214] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:08.814394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:08.814901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:08.814993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:08.843526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:08.844737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:08.852920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 108/215] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:08.877664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fff8-b39e-4ed8-9deb-817b5af6992a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:08.899168 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fff8-b39e-4ed8-9deb-817b5af6992a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:08.904059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:08.904830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:08.905104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:08.905373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:08.924120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:08.930883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:08.932056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 108/216] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:08.938563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:08.951637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e240f-69e4-40ac-b101-5324c86a2a8b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:08.964023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:08.964684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:08.964959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:08.965226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:08.965997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] RBAC: Adding query filter params (name=member) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:08.966296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:08.967917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:08.984590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 109/217] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:08.990856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:09.003872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6080-6774-43d4-8483-9100ff5c75c5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:09.014577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:09.015445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:09.015718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:09.015986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:09.020094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:09.022199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:09.023838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 109/218] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:08 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:09.030163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:09.044044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d8e8d-e5c9-42ef-8b39-26e53760293c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:09.054584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:09.055239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:09.055601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:09.055876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:09.074759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:09.076516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:09.088044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 110/219] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:09.094245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:09.110481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9d1a8-8401-4f0f-952f-c9770d30ac19 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:09.118667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:09.119701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:09.119980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:09.120250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:09.127370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:09.129410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555a0e-9067-4107-b654-b4d275ae4047 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:09.131551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 110/220] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:09 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:09.138481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:09.151669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22475a82-2d3f-464e-b1c6-7b4cf4e63d92 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:09.158594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:09.159248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:09.159527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:09.159799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:09.160645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] RBAC: Adding query filter params (role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=41f11753c1114966bbbe3e9c7e01675b) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:09.160951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:09.162823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fe15a-daec-4dd0-848a-5ab0dca63cce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:09.175056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 111/221] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:09 2021] GET /identity/v3/role_assignments?user.id=41f11753c1114966bbbe3e9c7e01675b&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.100995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7643a-c775-481e-844a-ea920b03eaf8 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.101723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7643a-c775-481e-844a-ea920b03eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.101723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7643a-c775-481e-844a-ea920b03eaf8 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.103422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 111/222] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:10.109638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.110175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.110175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.135818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:10.137023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:10.145512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 112/223] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:10.194154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7643a-c775-481e-844a-ea920b03eaf8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.212898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7643a-c775-481e-844a-ea920b03eaf8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.221874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.222706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.222987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.223256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.239665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:10.247418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:10.248566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 112/224] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:10.255062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.268319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fdb8b-5cb4-4e31-80b9-4ceece9aaccf None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.275406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.276075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.276355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.276630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.277397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:10.277704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.279335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea66f13-6213-4f30-9f7d-0a6cf5669634 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.290113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 113/225] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.296016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.300042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35627c-fa81-4166-972a-f6af1267265a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.300326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35627c-fa81-4166-972a-f6af1267265a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.300602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35627c-fa81-4166-972a-f6af1267265a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.302352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 114/226] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:10.309452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.309792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.310075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.310239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55085b3-8152-4778-9ca3-25cabe91105f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.316414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.317266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.317538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.317876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.322244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.324394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.326050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 113/227] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.332687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.348957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604452-d8ed-40e3-b410-bd077d645550 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.364901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.365564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.365843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.366141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.382832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.384780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.397684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 114/228] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:34:10.404329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.415999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecc8f1-ed0a-4762-a09a-d46906bfa1ed admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.428748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.429625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.429904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.430174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.435426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.437518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.439681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 115/229] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.445809 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.459200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:10.459491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc660c-ab4f-4e37-bb5d-acf7cd6cbb13 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.460479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:10.469693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.470778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.471612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.471896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.474218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=41f11753c1114966bbbe3e9c7e01675b) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:10.474562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.475596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 115/230] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:10.476686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.483997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 116/231] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/role_assignments?user.id=41f11753c1114966bbbe3e9c7e01675b&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=ee902deb77954618a3800ef701089e61 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:10.514073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.523341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6159473-2df9-4208-94e8-c0892309c0b9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.528020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.528857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.529140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.529411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.543379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:10.550342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:10.551754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 116/232] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:10.558215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.568210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec58c6-19d3-4dee-8b88-edcf057187e4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.573357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.574010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.574294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.574594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.575420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:10.575727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.577367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.586842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.593302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.604594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182bf94-67f8-491b-943f-3ecb646b87b4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.611329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.612201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.612529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.612805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.614043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.615932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.618071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 117/234] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.624028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.636819 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6c21-645d-4f06-8336-4962d2423765 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.641592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.642254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.642537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.642879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.653636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.655464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.667892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 118/235] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:10.673719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.684102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6d50-b710-4742-88a9-657c003db99e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.688925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.689848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.690135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.690413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.691714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.693796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22807-cd5f-4b0b-8f46-4c348b221735 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.695572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 118/236] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:10.702732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:10.712178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a5486-231b-43ec-ada9-bc27974d91f8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:10.716745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:10.717389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:10.717668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:10.717941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:10.718816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=4179a663c0e248e299c331187a356f37, user.id=ccbaff1ca24443ce904c9dbb2942c081) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:10.719123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:10.720964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febc556-5d25-4d43-8115-744aea26d135 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:10.727945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 119/237] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:10 2021] GET /identity/v3/role_assignments?user.id=ccbaff1ca24443ce904c9dbb2942c081&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.230329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afe8c-3ae7-4d0c-8c79-7993d00a8176 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.231033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afe8c-3ae7-4d0c-8c79-7993d00a8176 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.231033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afe8c-3ae7-4d0c-8c79-7993d00a8176 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.232670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 119/238] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:11.240553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.241095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.241095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.260852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:11.261971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:11.269956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:11.295895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afe8c-3ae7-4d0c-8c79-7993d00a8176 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.308774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afe8c-3ae7-4d0c-8c79-7993d00a8176 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.314234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.315053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.315334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.315609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.327670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:11.334613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:11.335830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 120/240] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:11.346960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.357125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1925bc-baf4-4067-b845-88c8d8fad4ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.363724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.364392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.364670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.365009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.365785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:11.366091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.367714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.376905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 121/241] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.383441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.395515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38415-2537-45fd-84be-c00c7124ed1b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.400285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.400939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.401219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.401550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.410032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.411812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.421342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 121/242] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:11.427679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.437542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09272-7c93-4cd9-88a9-031228e2c837 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.442973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.443843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.444122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.444579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.445817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.448451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.450146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 122/243] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.456486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.466188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ced1f-e38a-4fb2-90ee-70245a8fbc44 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.472856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.473798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.474080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.474353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.482954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.484003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:11.484003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:11.484003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:11.485287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20477015-817d-4903-bb0d-b38c508b93a7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.487397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 122/244] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.494017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.504554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33162e-2188-48bb-8357-6825d861a436 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.512537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.513123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.513457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.513728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.514656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=ba932071ba8140599ec7bb20c2d16789) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:11.515020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.516983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e7cc-91e9-4221-92cf-33d60e1b154a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.523946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 123/245] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.678756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2f5-7095-4b3e-8595-307592b3892e None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.679137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2f5-7095-4b3e-8595-307592b3892e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.679454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67b2f5-7095-4b3e-8595-307592b3892e None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.681671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 123/246] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:11.689154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.689328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.689667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.713665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:11.714991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:11.724557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 124/247] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:11.752859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67b2f5-7095-4b3e-8595-307592b3892e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.765066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67b2f5-7095-4b3e-8595-307592b3892e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.769610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.770422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.770756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.771034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.783748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:11.791360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:11.792904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:11.799417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.809391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faacce1-5beb-4cf5-835e-1e1631b4fcef None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.815075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.815793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.816078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.816353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.817123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:11.817427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.819095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.828280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 125/249] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.834780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.845902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e84e4-1be3-465e-b792-2e260523dc3e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.850595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.851278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.851556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.851831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.863045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.864880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.876904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 125/250] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:11.883025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.893837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3590-b174-49f1-b60e-9685920b4406 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.898387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.899346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.899635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.899912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.903063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.905173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.907062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 126/251] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:11.913162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.922991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73d71e-368f-4a18-8d65-78de8de35e8f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.927781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.928677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.929003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.929328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.930601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.933146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823cb9-912d-4be0-8c92-408c8645cead admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.935118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 126/252] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:11.941610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:11.951929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c992d-f881-44db-aaf6-1645639462d9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:11.957471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:11.958116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:11.958445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:11.958760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:11.959606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=ee902deb77954618a3800ef701089e61, scope.project.id=ba932071ba8140599ec7bb20c2d16789) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:11.959971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:11.961952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cb2b3-ecd1-48cd-bb57-fb58acaca343 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:11.968268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 127/253] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:11 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=ee902deb77954618a3800ef701089e61 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:12.319313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde51-30c4-4dd4-97d7-4749e25ebd6f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.319998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde51-30c4-4dd4-97d7-4749e25ebd6f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.319998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde51-30c4-4dd4-97d7-4749e25ebd6f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.321841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 127/254] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:12.327773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.328291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.328444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.347808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:12.349003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:12.357568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 128/255] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:12.385441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bde51-30c4-4dd4-97d7-4749e25ebd6f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.398605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bde51-30c4-4dd4-97d7-4749e25ebd6f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.403418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.404200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.404475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.404744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.420781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:12.427655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:12.428851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 128/256] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:12.435969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.444919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de388-b29e-4c96-becc-06c794e359bd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.454579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.455255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.455529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.455797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.456563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:12.456860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:12.458463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:12.468046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 129/257] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:12.475003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.487502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476e09e-67e0-42ad-bb8a-e91ff68d8daf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.493509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.494184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.494457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.494749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.506741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:12.508488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:12.520285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 129/258] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:12.527319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.539496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2161d8b-b5ec-490d-8509-a5880b73d656 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.546641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.547497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.547771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.548068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.549244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:12.551323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:12.553144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 130/259] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:12.559789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.569158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d8b0-2d84-4458-b14a-aeb757183fab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.578658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.579460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.579739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.580014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.581210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:12.583150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d009e1-ad60-414b-a050-d383cf2fbbe3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:12.585048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:12.591789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:12.601573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aab8b-1983-41fa-9c30-ef7d1e69e53e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:12.614599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:12.615258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.615531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.615799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.616637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=4179a663c0e248e299c331187a356f37) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:12.616939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:12.623417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647febe-c05e-416e-b513-665c786a1ba6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:12.629694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 131/261] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:12.907060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334abde-bcc6-4b59-93a8-37e51970f8e5 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.907395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334abde-bcc6-4b59-93a8-37e51970f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.907559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334abde-bcc6-4b59-93a8-37e51970f8e5 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.909296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 131/262] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:12.916141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:12.916412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:12.916686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:12.940436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:12.941643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:12.950820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 132/263] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:12.980759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334abde-bcc6-4b59-93a8-37e51970f8e5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.001883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334abde-bcc6-4b59-93a8-37e51970f8e5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.007673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.008533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.009391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.009672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.024150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:13.031951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:13.033519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 132/264] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:13.039577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.049083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db96b6-efd4-4a5a-8f6d-13bede0a60dc None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.064191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.064882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.065158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.065419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.066192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:13.066492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:13.068203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:13.084534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 133/265] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:13.090782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.103995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c2a03-8e74-45b1-9c59-3e2404ffc4a8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.109749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.111287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.111583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.111861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.127487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:13.129238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:13.142760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 133/266] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:13.148706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.159710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd995a5-08e4-4a8e-b2c6-bf3d2d03daa8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.166379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.167303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.167583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.167851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.170937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:13.173007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:13.174994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 134/267] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:13 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:13.181326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.191692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a15c7-92cd-48ae-b7a8-1180d20a467f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.197519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.198686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.199190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.199677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.201226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:13.203433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105f040-e97f-496b-b0e3-ec4e249222cb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:13.205351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:13 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:13.212270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:13.228255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eafaa-c3f1-402b-b647-aa85bdf6c24e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:13.232717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:13.233356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:13.233635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:13.233908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:13.234772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=ee902deb77954618a3800ef701089e61, scope.project.id=4179a663c0e248e299c331187a356f37) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:13.235086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:13.236911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72e84-bf72-478e-a686-d761e7b8254a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:13.242620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 135/269] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:13 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=ee902deb77954618a3800ef701089e61 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.091124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655276-06b5-4c6d-9beb-3dc4b250475a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.091653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655276-06b5-4c6d-9beb-3dc4b250475a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.091759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655276-06b5-4c6d-9beb-3dc4b250475a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.093882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 135/270] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:14.099845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.100707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.101192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.120286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:14.121787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:14.129616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 136/271] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:14.154724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655276-06b5-4c6d-9beb-3dc4b250475a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.167373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655276-06b5-4c6d-9beb-3dc4b250475a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.172030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.173100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.173587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.174131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.185011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:14.191980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:14.193440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 136/272] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:14.200598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.209658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcaae1-3f7d-4cfd-b4b0-78ad609a81b2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.214211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.214924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.215198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.215463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.216263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:14.216563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.218136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.226992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 137/273] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.233743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.247794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23580010-f820-429a-81c6-567363c70cc7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.252282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.252935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.253194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.253462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.263224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.264963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.277662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 137/274] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:14.284055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.294496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159779e-7ca8-4555-8022-ad1449763bcd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.302675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.303578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.303851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.304117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.305338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fba8b4340c45198a97460c74be901e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.307335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.310270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 138/275] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/projects/e2fba8b4340c45198a97460c74be901e => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.315649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.325768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb20296-bf89-4540-a83a-c16278379a84 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.330410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.331291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.331565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.331831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] PATH_INFO: `/v3/groups/6713b24f2e514c56a24067a539a0a55a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.337680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] RBAC: Authorizing `identity:get_group(group_id=6713b24f2e514c56a24067a539a0a55a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.339705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23450be-fc7c-4aa5-9708-9c390c070f2b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.341633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 138/276] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/groups/6713b24f2e514c56a24067a539a0a55a => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.348277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.358993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba0e9-1087-4094-b4b4-45cbbdb2f565 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.364630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.365360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.365612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.365880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.366749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] RBAC: Adding query filter params (group.id=6713b24f2e514c56a24067a539a0a55a, role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=e2fba8b4340c45198a97460c74be901e) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:14.367054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.369038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d69a7-8ef4-467b-84ad-fcffd1f185f2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.382733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 139/277] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/role_assignments?group.id=6713b24f2e514c56a24067a539a0a55a&scope.project.id=e2fba8b4340c45198a97460c74be901e&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.641419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307958f7-0857-44a0-acaa-f735896e7032 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.641789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307958f7-0857-44a0-acaa-f735896e7032 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.641981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307958f7-0857-44a0-acaa-f735896e7032 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.643880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 139/278] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:14.650534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.650874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.651145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.675412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:14.676605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:14.685206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 140/279] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:14.722910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307958f7-0857-44a0-acaa-f735896e7032 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.740375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307958f7-0857-44a0-acaa-f735896e7032 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.746356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.747201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.747473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.747740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.765101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:14.772133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:14.773645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 140/280] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:14.780275 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.790110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c6e0a-3cc4-481c-9f75-edb9a23c7693 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.798676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.799343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.799631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.799890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.800650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:14.800955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.802531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.811849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 141/281] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.818311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.837379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024e46-f743-4241-b5ca-bc918b985d54 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.842692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.843619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.843907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.844165 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.851348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.853272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.854955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 141/282] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.861262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.871708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888b727-5229-45c6-b3ed-3ab54a1bd895 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.878648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.879499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.879776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.880045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.881251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.883298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891e8c-f9f0-4f7a-9046-9ca1ff6dffbd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.885869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 142/283] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:14 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:14.892508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:14.902685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e150a4-420c-4480-98cf-45bc465864f5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:14.910571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:14.911426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:14.911696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:14.911960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:14.913928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba932071ba8140599ec7bb20c2d16789, group_id=5cd59647a64f4d7da2d9ededac97bea3, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:14.917100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148e9e9-60cf-4a9e-a38c-3b66f40a3703 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:14.938745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 142/284] 10.222.0.36 () {58 vars in 1463 bytes} [Mon Oct 18 18:34:14 2021] PUT /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:15.163592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89270f0b-d074-4450-b963-3d24d36f5335 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.164280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89270f0b-d074-4450-b963-3d24d36f5335 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.164280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89270f0b-d074-4450-b963-3d24d36f5335 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.166145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 143/285] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:15.172124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.172716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.172716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.201107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:15.202292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:15.276150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 143/286] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:15.305357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89270f0b-d074-4450-b963-3d24d36f5335 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:15.324131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89270f0b-d074-4450-b963-3d24d36f5335 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:15.328423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:15.329213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.329487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.329754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.341164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:15.352119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:15.353615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:15.359983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:15.369540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd437a-8f8b-4261-900b-05987918a2ed None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:15.375229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:15.375884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.376159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.376429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.377186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:15.377494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:15.379096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:15.388253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 144/288] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:15.398362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:15.409500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267f02-651a-4783-9ba8-991954a8dcee admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:15.414374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:15.415766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.416037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.416310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.417501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:15.418635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:15.418635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:15.418635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:15.419891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:15.422655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:15 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:15.428055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:15.439771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bc99e-2b8e-4e5b-bf67-70d05be73437 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:15.445948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:15.446889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.447164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.447433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.449844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:15.451900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11692ba1-3842-441e-ac21-8b2da8b26d6b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:15.453575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 145/290] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:15 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:15.460111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:15.471222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd649f-2980-4e46-9ae7-238245940fed admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:15.476358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:15.477533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:15.478079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:15.478534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/ee902deb77954618a3800ef701089e61` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:15.481056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba932071ba8140599ec7bb20c2d16789, group_id=5cd59647a64f4d7da2d9ededac97bea3, role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:15.484018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9105d-908c-46e6-b55d-cc0e95fe6e89 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:15.501119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 146/291] 10.222.0.36 () {58 vars in 1463 bytes} [Mon Oct 18 18:34:15 2021] PUT /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/ee902deb77954618a3800ef701089e61 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:34:16.169309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8530-84c6-4f16-b807-3cf77b8379a1 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.169673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8530-84c6-4f16-b807-3cf77b8379a1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.169843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8530-84c6-4f16-b807-3cf77b8379a1 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.171882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 146/292] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:16.178011 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.178537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.178537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.197831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:16.199045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:16.205359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15a13-c86b-4650-bfc1-789c51a4ac18 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.205911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15a13-c86b-4650-bfc1-789c51a4ac18 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.205911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15a13-c86b-4650-bfc1-789c51a4ac18 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.207796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 147/293] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:16.214225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.214506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.214806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.237709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:16.238945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:16.282646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 147/294] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:16.336035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 148/295] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:16.337912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.352818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3abc2-3bcc-443b-b1cc-51002f0774ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.363579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.363852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.364031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.364031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.364031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.373116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b1a5-4135-4fc8-beef-4165d63bf059 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.378591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:16.385717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.386709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:16.387059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.387540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.387957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 148/296] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:16.388303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.394405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.404885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aec1f-88db-4593-8f5d-2e5192f6e136 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.408202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:16.416502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:16.418024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 149/297] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:16.423417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.424208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.424483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.424754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.425411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.425588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] RBAC: Adding query filter params (name=member) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:16.425876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.427559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.444008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 149/298] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:16.445235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d6f1-2fbc-4b0f-af43-8cc48acdfea0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.450928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.462409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f59b-ec73-4035-b65d-390bbd3087df admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.463311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.464253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.464755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.465266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.466193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:16.466757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.468906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.479618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.482030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.482498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.483067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.486685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.491268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.491693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 150/299] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:16.493894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 150/300] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:16.499927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.504259 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.518677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158a92-6ce8-499c-963d-cba076daf204 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.523545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857209ca-5a49-4da1-aa6f-354f452ae0de admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.532031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.533407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.533978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.534825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.535757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.536692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.536967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.537237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.538796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.540861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.543829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.544039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.545603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:16.546318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:16.551975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.552961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.564380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2c3f-bc30-4a6d-9165-ed393597eb56 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.568036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe27f1-24c7-4326-ac1b-f610bfa1a598 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.578474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.579889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.581059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.582114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.582643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.583145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.583618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.584933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.586994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.587935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179a663c0e248e299c331187a356f37, group_id=5cd59647a64f4d7da2d9ededac97bea3, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.590209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.593100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94768361-e272-4019-9f30-6df7796eeae2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.595103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 152/303] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:16 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:16.605531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:16.615935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193ac5-f620-4820-a3b9-e5635efd368b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:16.625389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 152/304] 10.222.0.36 () {58 vars in 1463 bytes} [Mon Oct 18 18:34:16 2021] PUT /identity/v3/projects/4179a663c0e248e299c331187a356f37/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:16.631965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:16.632869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:16.633156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:16.633434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/ee902deb77954618a3800ef701089e61` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:16.636822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179a663c0e248e299c331187a356f37, group_id=5cd59647a64f4d7da2d9ededac97bea3, role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:16.639640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2c517-6ea2-407d-9d6b-c1126f357b9f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:16.665397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 153/305] 10.222.0.36 () {58 vars in 1463 bytes} [Mon Oct 18 18:34:16 2021] PUT /identity/v3/projects/4179a663c0e248e299c331187a356f37/groups/5cd59647a64f4d7da2d9ededac97bea3/roles/ee902deb77954618a3800ef701089e61 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:17.266178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ba27-d7f8-4c80-abb4-906ea9ef95b0 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.267134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ba27-d7f8-4c80-abb4-906ea9ef95b0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.267645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ba27-d7f8-4c80-abb4-906ea9ef95b0 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.269868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 153/306] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:17.277196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.278065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.278564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.297484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:17.299054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:17.362438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 154/307] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:17.405436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9ba27-d7f8-4c80-abb4-906ea9ef95b0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:17.420835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9ba27-d7f8-4c80-abb4-906ea9ef95b0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:17.431182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:17.432252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.432755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.433231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.444174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:17.451728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:17.453120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:17.459637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:17.474414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecba7-1368-4585-a663-2a85f16dba98 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:17.483480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:17.484427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.484914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.485415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.486385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:17.486913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:17.488786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:17.498160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:17.504618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:17.520156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47245-8940-4aec-97b3-4bec7a201c98 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:17.526328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:17.527455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.527942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.528433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] PATH_INFO: `/v3/groups/6713b24f2e514c56a24067a539a0a55a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.535267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] RBAC: Authorizing `identity:get_group(group_id=6713b24f2e514c56a24067a539a0a55a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:17.537385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:17.539249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 155/310] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:17 2021] GET /identity/v3/groups/6713b24f2e514c56a24067a539a0a55a => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:17.545574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:17.556343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bdd7b-374f-4625-bc2f-9a5e221af4a5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:17.566804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:17.567969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.568470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.568942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.570397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fba8b4340c45198a97460c74be901e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:17.572491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29fba8-c56e-412f-ab08-42287f1c1d50 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:17.574393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 156/311] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:17 2021] GET /identity/v3/projects/e2fba8b4340c45198a97460c74be901e => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:17.580895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:17.591665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e615-466c-4929-b319-d7e491faff5e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:17.602451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:17.603356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:17.603634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:17.603908 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e/groups/6713b24f2e514c56a24067a539a0a55a/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:17.611883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fba8b4340c45198a97460c74be901e, group_id=6713b24f2e514c56a24067a539a0a55a, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:17.614499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8274d8e-2ff5-4252-a6e8-b5183c3ddc81 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:17.639881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1463 bytes} [Mon Oct 18 18:34:17 2021] PUT /identity/v3/projects/e2fba8b4340c45198a97460c74be901e/groups/6713b24f2e514c56a24067a539a0a55a/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:18.072525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a84-35e5-438e-bdb9-3664fdb78bc0 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.073155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a84-35e5-438e-bdb9-3664fdb78bc0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.073678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4a84-35e5-438e-bdb9-3664fdb78bc0 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.075948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 157/313] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:18.081436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.081952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.082434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.111788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:18.113048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:18.200714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 157/314] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:18.242723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4a84-35e5-438e-bdb9-3664fdb78bc0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.264189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4a84-35e5-438e-bdb9-3664fdb78bc0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.271998 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.273018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.273502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.273974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.285076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:18.296849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:18.298606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:18.304711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.314417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06d60-5749-4ef5-b5bc-fe2ba5fcc332 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.327133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.327911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.328242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.328516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.329293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] RBAC: Adding query filter params (name=member) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:18.329596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.331319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.350350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 158/316] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.357065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.373376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c0073-a7d4-42f4-80be-03c1415bea66 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.388146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.389144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.389632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.390124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.400694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.402700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.419198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 159/317] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:18.425087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.439498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65fb7-d802-4f75-a5c8-95124e5de26c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.451466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.452360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.452637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.452952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.454807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.457087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.458964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.465255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.474764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7b5d-f20a-45dd-9a51-fd4342c2ed96 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.486580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.487646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.488131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.488584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.489946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.492100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc1efd-8273-49ec-939f-3ffe74a3e8b6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.494643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 160/319] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.501019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.514847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f26f8-6c40-4e80-ac2e-978e828ee80a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.525346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.525994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.526322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.526618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.527509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=ba932071ba8140599ec7bb20c2d16789) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:18.527815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.529712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e52cd-a23d-47c0-820c-aa5d08a33444 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.536219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 160/320] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.558578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298e10-e914-4861-8c87-8496f154c32b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.559216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298e10-e914-4861-8c87-8496f154c32b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.559701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298e10-e914-4861-8c87-8496f154c32b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.562162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 161/321] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:18.568863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.569154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.569423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.595537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:18.596830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:18.606065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 161/322] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:18.632035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298e10-e914-4861-8c87-8496f154c32b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.652182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298e10-e914-4861-8c87-8496f154c32b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.662776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.663573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.663860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.664131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.675170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:18.682450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:18.684072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 162/323] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:18.690305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.706582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf2ed-1971-4184-8a6b-328e18208f8a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.716492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.717434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.717867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.718279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.719274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:18.719729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.721571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.738171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 162/324] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.745139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.757859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321d09-fe5b-4197-82e7-0f036a4d9cff admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.766930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.767889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.768347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.768794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.783387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.785151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.802450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 163/325] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:18.810267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.823806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9dca-d4d4-480a-90a1-eac34cdca128 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.830995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.831853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.832128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.832393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.834441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.836508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.839548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 163/326] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.844725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.856495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ba07-d31e-43f7-89d3-9320a2e28452 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.863760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.864599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.864870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.865131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.867382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.869338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589096b-1027-430d-836e-95f4fbb6bf97 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.871011 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 164/327] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:18.877730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:18.889834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011ef2-1a54-44f3-8c47-79cfc16aa302 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:18.897775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:18.898422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:18.898720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:18.898988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:18.900192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=ee902deb77954618a3800ef701089e61, scope.project.id=ba932071ba8140599ec7bb20c2d16789) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:18.900498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:18.902319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d709-7d44-45d0-8672-b5bbfaf065a4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:18.910871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:18 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=ba932071ba8140599ec7bb20c2d16789&role.id=ee902deb77954618a3800ef701089e61 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:19.289956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d045a-6611-414b-aae0-d5e2042dff12 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.290483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d045a-6611-414b-aae0-d5e2042dff12 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.290483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d045a-6611-414b-aae0-d5e2042dff12 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.292550 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 165/329] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:19.298742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.299032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.299312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.319393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:19.320594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:19.328229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 165/330] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:19.353152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d045a-6611-414b-aae0-d5e2042dff12 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.367001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d045a-6611-414b-aae0-d5e2042dff12 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.371946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.372716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.372989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.373255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.386713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:19.393626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 18:34:19.395187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:19.401395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.411040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e025-29cc-4f84-8bb7-94498297af20 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.416068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.416735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.417037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.417283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.418048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] RBAC: Adding query filter params (name=member) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:19.418353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:19.419981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:19.428775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:19.435134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.445037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779ea8-1316-44db-8eb3-86f042530950 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.450499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.451453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.451925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.452389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.461283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:19.463710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:19.474038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 167/333] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:19.480501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.490419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f2533-98d6-4c6c-b8b2-124fbb933180 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.494956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.495793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.496066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.496335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.497524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:19.499590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:19.501240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 167/334] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:19.507632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.517305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851a46a-13ab-4a4b-9606-5c41ee947ef7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.525284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.525284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.525284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.525284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.526579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:19.528101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b918-6bd6-40a4-b5e3-055233873384 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:19.530097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 168/335] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:19.537341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.548791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dad5f-db72-4319-a480-de919bf21bc1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.553252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.553913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.554172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.554447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.555383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=08471874b3754abaaf1e0e0228dc34d1, scope.project.id=4179a663c0e248e299c331187a356f37) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:19.555690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:19.557532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6db7f-0e6d-403f-8b6b-25d606b3906a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:19.563744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 168/336] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=08471874b3754abaaf1e0e0228dc34d1 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:19.903768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf97c1-4e20-4ae8-8d77-c06b3c875608 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.904129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf97c1-4e20-4ae8-8d77-c06b3c875608 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.904304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf97c1-4e20-4ae8-8d77-c06b3c875608 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.906058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 169/337] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:19.912112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.912390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.912657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.931077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:19.932590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:19.940410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:19.965591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf97c1-4e20-4ae8-8d77-c06b3c875608 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:19.977854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf97c1-4e20-4ae8-8d77-c06b3c875608 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:19.982089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:19.982906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:19.983180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:19.983447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:19.994575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:20.001630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:20.002812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 170/339] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:20.009707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.018747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550b94-55b6-43f0-b081-69a1ecd3402e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.023065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.023711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.023988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.024785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.025542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:20.025841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.027450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.035404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 170/340] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.041983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.051355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05225e7-a8a4-4491-8297-b63d212e5f0e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.055656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.056277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.056557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.056829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.064817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.066554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.075263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:20.080966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.091334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1785f3-4191-45a5-b8d8-d9815d30b8b2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.095992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.096864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.097134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.097404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.098863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.101191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.103676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 171/342] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.110157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.119430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc082-cd35-4e14-b61b-9ece96e4fa6f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.123942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.124793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.125078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.125350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] PATH_INFO: `/v3/groups/5cd59647a64f4d7da2d9ededac97bea3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.126571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] RBAC: Authorizing `identity:get_group(group_id=5cd59647a64f4d7da2d9ededac97bea3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.128459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eb1a5-5c03-4fad-bc5f-26e522aa5888 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.130055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 172/343] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/groups/5cd59647a64f4d7da2d9ededac97bea3 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.136964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.146662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e5ba-c359-4fd3-b8e7-0d390a303d63 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.151490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.152125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.152406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.152683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.153515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] RBAC: Adding query filter params (group.id=5cd59647a64f4d7da2d9ededac97bea3, role.id=ee902deb77954618a3800ef701089e61, scope.project.id=4179a663c0e248e299c331187a356f37) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:20.153870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.155690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64ac0-a067-4995-bec3-85f1fe601f90 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.161398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 172/344] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/role_assignments?group.id=5cd59647a64f4d7da2d9ededac97bea3&scope.project.id=4179a663c0e248e299c331187a356f37&role.id=ee902deb77954618a3800ef701089e61 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.253945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c722-9213-426b-8949-280c529a17ed None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.254225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c722-9213-426b-8949-280c529a17ed None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.254503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0c722-9213-426b-8949-280c529a17ed None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.256372 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 173/345] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:20.263653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.263934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.264225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.284088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:20.285297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:20.292902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 173/346] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:20.317582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c722-9213-426b-8949-280c529a17ed None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.330314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0c722-9213-426b-8949-280c529a17ed None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.334588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.335377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.335652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.335921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.347263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:20.354141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:20.355558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 174/347] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:20.361921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.371324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b8e1-660d-4c23-91c1-27193b0cd38c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.375706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.376350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.376622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.376889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.377638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:20.377936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.379621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.388775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 174/348] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.395251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.405599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac9d9c-d59e-4a94-86cd-9abbe7c597c7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.409916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.410563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.410854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.411131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.419623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.421357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.430143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:20.436380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.446567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc11a7-db28-4311-bc75-5ddbb8ad70f3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.451038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.451905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.452185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.452457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.453654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fba8b4340c45198a97460c74be901e)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.455465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.457121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 175/350] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/projects/e2fba8b4340c45198a97460c74be901e => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.463771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.473440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e752e-1cef-4770-98ee-99745458d9f3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.477889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.478766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.479045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.479329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] PATH_INFO: `/v3/groups/6713b24f2e514c56a24067a539a0a55a` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.480495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] RBAC: Authorizing `identity:get_group(group_id=6713b24f2e514c56a24067a539a0a55a)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.482409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70adde-9105-41ee-879d-a7c25441408e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.484016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 176/351] 10.222.0.36 () {56 vars in 1201 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/groups/6713b24f2e514c56a24067a539a0a55a => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:20.490466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:20.500155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6271-c6d2-4d11-a522-b13815121075 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:20.504560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:20.505189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:20.505467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:20.505738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:20.506602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] RBAC: Adding query filter params (group.id=6713b24f2e514c56a24067a539a0a55a, role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=e2fba8b4340c45198a97460c74be901e) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:20.506912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:20.509649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e23ed-fda5-419b-84a8-908209b29482 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:20.515902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 176/352] 10.222.0.36 () {56 vars in 1397 bytes} [Mon Oct 18 18:34:20 2021] GET /identity/v3/role_assignments?group.id=6713b24f2e514c56a24067a539a0a55a&scope.project.id=e2fba8b4340c45198a97460c74be901e&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:23.181882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4423a8-97f6-413f-b0d8-1008a5271e3a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.182390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4423a8-97f6-413f-b0d8-1008a5271e3a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.182390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4423a8-97f6-413f-b0d8-1008a5271e3a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.184468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 177/353] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:23.190890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.191712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.192182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.215779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:23.217577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:23.225923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 177/354] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:23.280240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4423a8-97f6-413f-b0d8-1008a5271e3a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.300410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4423a8-97f6-413f-b0d8-1008a5271e3a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.308012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.308807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.309088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.309359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.322677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.324505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.346341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c13714c4-9d08-4e18-9915-809af54f4c30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:23.347552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:23.354265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.367590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d336a3-0c97-447d-be04-a27092ce7b3d None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.367936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d336a3-0c97-447d-be04-a27092ce7b3d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.368190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d336a3-0c97-447d-be04-a27092ce7b3d None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.368508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1bdc-3f5f-4f0a-8b21-d609ecddf67e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.373141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 179/356] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:23.375990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.376271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.376542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.387242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.388217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.388692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.389172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.390120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:23.390672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.392462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.396257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:23.397449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:23.409144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 178/357] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:23.413767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 180/358] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:23.419541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.431549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674abfe1-97fb-4865-8f5d-57a4fd981c40 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.438631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.439298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.439576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.439849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.440568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.442465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.471420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.473894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 179/359] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/users => generated 246 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:23.489074 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd7921-a425-4113-a6e5-6226be1a8219 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.496816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.497855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.498150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.498471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.519292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.521177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.549014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:23.550653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 181/360] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:23.557887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.577508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823d1b7-99a1-409c-b6b5-0dbec4f4fd4e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.587006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.587697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.588014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.588291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.589076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:23.589377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.593445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d33d8-7329-470d-942f-df8214aca48c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.612017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 180/361] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:23.619052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.632118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d431c-5f20-405f-a8cb-54f294b073ec admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.640257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.641025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.641305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.641735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.643163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.644224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:23.644224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:23.644224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:23.645440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede61e9-01da-4ea1-aa3c-d50a901663b1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.689331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 182/362] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/users => generated 248 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:23.788241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b0a7-8514-4d40-bfb4-6355d617c696 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.788569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b0a7-8514-4d40-bfb4-6355d617c696 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.788782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b0a7-8514-4d40-bfb4-6355d617c696 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.791119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 181/363] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:23.797569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.797838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.798107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.821247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:23.822390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:23.836077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 183/364] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:23.863488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848b0a7-8514-4d40-bfb4-6355d617c696 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.879205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848b0a7-8514-4d40-bfb4-6355d617c696 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.888467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.889294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.889572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.889846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.903128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.905047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.927204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:23.934116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 182/365] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:23.935536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.944836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aa9eb-2ad7-44c3-82fb-aaf2919d4b9a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:23.953773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:23.953773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:23.954211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:23.954211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:23.954904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:23.955272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:23.956228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:23.956228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:23.956228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:23.957134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e64b17-ccfb-469f-8dc6-85ee0cb11699 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:23.981135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 184/366] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:23.987097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:23.998961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637520d3-e757-4631-bbd5-acf9e4c0e833 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:24.007534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:24.008210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.009020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.009293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.010021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:24.012230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794602-2ac4-4e2d-9c96-710d7af16c4f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:24.050746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 183/367] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:23 2021] POST /identity/v3/users => generated 248 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:24.378946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a669fb-8aac-4ca7-9852-6f2c8a018995 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.379486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a669fb-8aac-4ca7-9852-6f2c8a018995 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.379748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a669fb-8aac-4ca7-9852-6f2c8a018995 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.381551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 185/368] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:24.388860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.389263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.389448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.408383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:24.409557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:24.417700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 184/369] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:24.442875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a669fb-8aac-4ca7-9852-6f2c8a018995 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:24.455344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a669fb-8aac-4ca7-9852-6f2c8a018995 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:24.459601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:24.460374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.460652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.460921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.472542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:24.474493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:24.492178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:24.494178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 186/370] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:24.500551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:24.509437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088eefb9-73b1-48dd-a1d5-2e5c8315a0e4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:24.514128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:24.514793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.515071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.515829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.516567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:24.516872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:24.518461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1afe8-1468-4c19-a5de-7891eea5af26 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:24.530319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 185/371] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:24.536413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:24.546317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268089a-57df-4787-a14a-9f8b6e73e726 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:24.550803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:24.551450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:24.551727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:24.552009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:24.552766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:24.554800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab268e2-5ff9-46ff-bc9f-ae4984127648 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:24.577195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 187/372] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:24 2021] POST /identity/v3/users => generated 249 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:25.081131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b4bc-5f44-4c59-a83b-a2729dd3966c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:25.081553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b4bc-5f44-4c59-a83b-a2729dd3966c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:25.081714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b4bc-5f44-4c59-a83b-a2729dd3966c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:25.083982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 186/373] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:25.091070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:25.091452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:25.091621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:25.112221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:25.113426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:25.124010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 188/374] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:25.148777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b4bc-5f44-4c59-a83b-a2729dd3966c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:25.163160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b4bc-5f44-4c59-a83b-a2729dd3966c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:25.169456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:25.170121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:25.170400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:25.170715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:25.171489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:25.173081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:25.182426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.sql.core [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 18:34:25.182426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 18:34:25.182426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [parameters: {'id': '8e28f9efb2674654b6d93344972adb5d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 18:34:25.182426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=109152) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 18:34:25.198185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 18:34:25.199894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 187/375] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:34:25 2021] POST /identity/v3/roles => generated 144 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:25.206439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:25.216084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a80b77-d6c3-4e89-81e6-9756e720d7b2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:25.220657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:25.221458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:25.221736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:25.222010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:25.234255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:25.241606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-75a4edf0-a66b-4cbd-9d98-1a4942d5cc64 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 18:34:25.243675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 189/376] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:25.251609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:25.262140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd648-9d6d-4dd4-a74f-89d706ad328d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:25.270820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:25.271481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:25.271766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:25.272045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:25.272809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:25.273166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:25.275861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a722d4f-f64d-422c-9e0c-0df73f90917b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:25.284743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 188/377] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:26.302901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa63d-ff58-413e-bac6-749d5bdd9516 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.303593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa63d-ff58-413e-bac6-749d5bdd9516 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.303593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa63d-ff58-413e-bac6-749d5bdd9516 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.305687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 190/378] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:26.312100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2192e-4365-47da-9628-98603936dc0f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.312659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2192e-4365-47da-9628-98603936dc0f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.312659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2192e-4365-47da-9628-98603936dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.333330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-bab2192e-4365-47da-9628-98603936dc0f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:26.334610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-bab2192e-4365-47da-9628-98603936dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:26.346863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 189/379] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:26.367134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa63d-ff58-413e-bac6-749d5bdd9516 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.382772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa63d-ff58-413e-bac6-749d5bdd9516 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.393072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.393865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.394143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.394415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.409695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:26.417392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:26.418967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 191/380] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:26.425414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2192e-4365-47da-9628-98603936dc0f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.435687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2192e-4365-47da-9628-98603936dc0f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.440336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.441005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.441286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.441559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.442335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:26.442670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.444268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.453448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 190/381] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:26.459758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.470019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc834f-b018-4e48-8a26-4e2a18a026e7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.475554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.476362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.476637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.476908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.489077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.490975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.507768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:26.509829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 192/382] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:26.516438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.526433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19c898-77ef-47ea-b268-ac06483e4149 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.530999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.531717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.531996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.532272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.533067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:26.533379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.535035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.547173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 191/383] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:26.553323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.563429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e93042-2c81-48aa-9e7a-f66124a15f1d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.567884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.568659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.568937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.569210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.577298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.579434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.593294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:26.594650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 193/384] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:26.600746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.610754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e01b4-48d9-4c05-887b-5a5cabc8a700 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.615395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.616052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.616384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.616664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.617516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:26.618349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.619401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:26.619401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:26.619401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:26.620588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.659242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 192/385] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:26.665444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.675272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd4122-e652-4b7f-bef4-2645dc24f152 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.679870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.681077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.681358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.681631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.689591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.691424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d56082-9dfa-4118-b9b9-4e78ec1ca22b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.700689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 194/386] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:26.706903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.717546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f5fe-671e-4b14-b4d7-c269e2a46f85 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.722102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.722966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.723249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.723525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.734790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.736718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.754949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf6b6-a45e-488d-919e-638227e3bccc None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.755233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf6b6-a45e-488d-919e-638227e3bccc None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.755515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf6b6-a45e-488d-919e-638227e3bccc None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.756037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:26.757533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 195/388] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:26.758569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 193/388] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:26.763697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.763984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.764264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.767037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.783484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a5b7-f9ec-434e-949d-232809872d2b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.785146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:26.786353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:26.792243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.792899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.793179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.793453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.794195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:26.794500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.798238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.801112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 196/389] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:26.813010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 194/390] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:26.818815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.828209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896696-1407-4ec6-9199-b67ab1ec39fb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.832787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.833570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.833850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.834127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.842022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.844044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.848047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.858009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6eca-21a9-4891-9520-92e5d63623cc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.867378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.870497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.871679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.871963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.877880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:26.879476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 197/391] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:26.887841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.889873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:26.897050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:26.898484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 195/392] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:26.912679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:26.936036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96574-1f88-4b7e-9d93-5e63f7dfd46d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:26.952317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:26.953001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:26.953275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:26.953547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:26.954321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:26.954650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:26.956296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:26.980182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 196/393] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:26.996221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.025438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1494-8122-47df-9110-e545391d831e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.027265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010cb33-5ca0-4fe0-b820-40bcbf76c648 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.032230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.033017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.033299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.033576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.034462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.034803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.035969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:27.035969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:27.035969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:27.037203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.043318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.044125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.044402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.044671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.058734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 198/394] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:27.066344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.073311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.076095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.077736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967871af-159d-40af-a83a-ec38dbfeefaf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.082749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.083420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.083756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.084296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.085654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.086016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.088009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.100569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 199/395] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.111590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:27.113139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 197/396] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.125018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.138069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386863f-7713-4948-9007-d8a91187acd2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.146148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.147209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.147699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.148197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.149244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.149779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.151681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f56686-e69f-48ed-924f-8fdf162d89a4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.170819 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 200/397] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.177308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.192650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d8e8-3fe6-4173-9103-66bcfd90253b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.203109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.203923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.204203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.204475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.212913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.223639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.225172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc798-b2e8-44f6-a07d-b8b09065661a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.225699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc798-b2e8-44f6-a07d-b8b09065661a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.226202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fc798-b2e8-44f6-a07d-b8b09065661a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.229206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 201/398] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:27.235079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.235618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.236098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.240143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 18:34:27.241717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 198/399] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.248247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.259493 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e90c00-c30f-4aef-9efd-b8bfd8a51fc1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.270365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.271628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:27.272780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.273065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.273340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.274330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:27.275256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.275619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.278082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.293104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 202/400] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:27.307183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 199/401] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.313715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.323564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793ea57-04a5-42a4-8f7a-1a8940844209 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.327852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.334625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.335301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.335584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.337395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.344552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e704a6c-31b4-433c-bac9-83247b6001ef admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.355150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.356018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.358101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.358385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.359209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.359911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.386893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 203/402] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:27.387532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:27.389489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.399369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:27.400189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00014f-8930-4240-9f12-ba375b1e67c4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.404867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.405704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 200/403] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.405965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.406135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.406319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.406794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.420686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02469e81-a8d9-4f7e-8ead-eabee00f7aff admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.424018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.425844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.436588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.437254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.437527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.437794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.438573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.438876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.440477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.457626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:27.459042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 204/404] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.466109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 201/405] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.467119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.482274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20aff-4611-45b9-8893-d218f9da0679 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.486895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.487522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.487797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.488066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.488791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.489086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.490680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.501661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.512232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ec36-12a6-4d85-9ace-1e5016eec0c2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.516826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 205/406] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.524758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.534488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.535312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.535590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.535857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.543179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f5ac-46e4-47c4-867e-1ed65ee25932 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.554223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.556118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.557583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.558372 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.558681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.558951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.571872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.574318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.586885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:27.586885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 202/407] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.592819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.598631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:27.600318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 206/408] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.608018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d99a-e544-4889-82d4-44d2563fabcf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.608935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.620995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.622587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.623068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.623511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.623830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7791d-bb31-46c6-965b-b2b3a8e39d28 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.625430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.626264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.628900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1827e-5722-438c-9d2e-4c24d06e71aa admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.633639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.635486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.636041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.637117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.639250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.639738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.643777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c1ce3-12d4-47da-948a-9eee0b7f2fd5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.656245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 203/409] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:27.660085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff484-3225-4df2-9585-d37b59409d5b None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.660085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff484-3225-4df2-9585-d37b59409d5b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.660085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff484-3225-4df2-9585-d37b59409d5b None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.660085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 204/410] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:27.664974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 207/411] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.665942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dff484-3225-4df2-9585-d37b59409d5b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.669355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.669355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.669355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.682483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dff484-3225-4df2-9585-d37b59409d5b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.687413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.687538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:27.688562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.688672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:27.689147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.689618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.696695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 208/412] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:27.702566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.702687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.702687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.714040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333fe4-66d4-4504-ba00-e246c8b44edd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.727980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 18:34:27.728447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.729418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 205/413] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.729540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.730009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.730214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.730738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.731926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d34f3e4c4a4244128b8d4d1ba548d270) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.732441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.734695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.740993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 209/414] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/role_assignments?user.id=d34f3e4c4a4244128b8d4d1ba548d270&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.742023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.745597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce919-5d2d-4013-b9bb-6e9a6a6c7f86 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.751787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.752532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b022b9-d8b7-493b-b852-754cb8d39956 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.753141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.753677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.754120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.757576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.758902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.759261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.759611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.760791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.761164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.762244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:27.762244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:27.762244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:27.763488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.768636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:27.777545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:27.779319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 206/415] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.787763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.809457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533288a2-3970-4c1f-84f6-9aa4b4ae1c47 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.810091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 210/416] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.816961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.819330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.820293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.821361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.821803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.823107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:27.823594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.830723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.834242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629e6ec-cbe4-451b-9d38-bf062cfe1de6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.843369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 207/417] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:27.845413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.846077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.846360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.846686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.855803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.857593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.868075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.884104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715203f9-20fe-4cd3-8566-1fca029712aa admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.885354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 211/418] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:27.886386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.896881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.897690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.897970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.898248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.901382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac20-b6a9-483b-aeec-fd10f903a83a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.917146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.917919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.918202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.918478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.920427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.922305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.942455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:27.944371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:27.953702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:27.963469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 208/419] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:27.964241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.982869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:27.983086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa554b-11a5-447d-8ad1-dff0ec1731f5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:27.984458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 212/420] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:27.993645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:27.997748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:27.998457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:27.998740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:27.999014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:27.999767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.000071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.001668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.012999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0abcfb-356f-4b36-be16-3f4da0d2833e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.014879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 209/421] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.022039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.029265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.029935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.030211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.030479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.031254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.031559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.033175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.039662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139e2d-e757-4fd5-939a-e536e023766f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.050403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.051233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.051513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.051784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.057221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 213/422] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.067888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.069912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.080405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.088642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 18:34:28.090457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 210/423] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/users/neutron => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:28.099954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8403761-0557-4638-8429-581e0acc8f9e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.101041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.110808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.111959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.113474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.115035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.123325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c071825-edb6-44e4-ae1a-a3dca0b54675 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.128972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.132213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.133725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.134211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.134914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.135680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.138699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.139265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.142356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.157916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:28.164818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 214/424] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:28.165996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.176194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 211/425] 10.222.0.36 () {56 vars in 1160 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.177119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960092e-bc53-4db0-afb2-a267f1c1e92c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.182879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.184675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.185333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.185612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.185885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.186740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.187051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.188890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.196120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43975db-5ca3-40f4-87f2-579b1d4ed9a3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.201206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 215/426] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.207306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.215904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.216573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.216856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.217135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.219258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d72c3-0229-45a1-9040-24cd573c057d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.224942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.225644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.225928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.226201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.227835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=c48e090bca024c92a9cf7c038d225777) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.228285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.230313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.234902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.236692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.240001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 216/427] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/role_assignments?user.id=c48e090bca024c92a9cf7c038d225777&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:28.252784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 212/428] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:28.259606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.272258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee184e85-535c-4cf5-8329-bf9fe5d8f81f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.284977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.285779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.286061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.286337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.301813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.303747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.335977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:28.337750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 217/429] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:28.344419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.364015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d028f6-3b57-4838-aa92-5633ec65411d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.369371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.370391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.378588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.379532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.380625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.381149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.383137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.403178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 213/430] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.409704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.420006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0bc22-f9a0-489a-af47-341fcff031e8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.424973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.426101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.426633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.427128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.435029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.437336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.458629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0f981f71-88ed-44db-9557-0e43f12c0ba2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:28.460274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 218/431] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:28.467172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.481263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa77-b912-461b-910d-fa0fad00525f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.486568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.487576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.488060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.488520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.489623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.490122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.499426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:28.499426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:28.499426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:28.501091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56afae-d9b1-4934-bc05-2a2711cea2d9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.519265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9993bf-faa8-4262-b8ac-46becd319a28 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.519549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9993bf-faa8-4262-b8ac-46becd319a28 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.519982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9993bf-faa8-4262-b8ac-46becd319a28 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.521888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 219/432] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:28.524757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 214/433] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.532456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9993bf-faa8-4262-b8ac-46becd319a28 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.535051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.535632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.536137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.556243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9993bf-faa8-4262-b8ac-46becd319a28 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.557400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:28.558998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:28.567989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:28.568990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.569709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.570052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.570391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.574594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=4c9e3e4d7b9d4bf0858c4c2562eb49e1) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.574594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.574594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.586243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 220/435] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/role_assignments?user.id=4c9e3e4d7b9d4bf0858c4c2562eb49e1&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:28.606985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.617975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e9cf-8cc7-4913-8730-9ee8a65c61c8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.624876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.626463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.627184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.627843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.641483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.643637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.669773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:28.671793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 216/436] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:28.679428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.696456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743614c-9fb8-4e66-b626-25be5d40ddf0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.708749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.709521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.709860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.710196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.711036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:28.712009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.713661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0d78-516d-4e8e-ad05-edb3589ec406 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.732229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 221/437] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:28.738337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:28.752141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c953e4-b1db-47bd-86ce-915757c8e9fa admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:28.757238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:28.758735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:28.759199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:28.759695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:28.760869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:28.763114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34545b4c-840d-4cd1-907d-e30c8c6ec12d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:28.799022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 217/438] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:28 2021] POST /identity/v3/users => generated 247 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:29.767271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f38e-1f09-4f30-a5a4-17e20b20a60a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:29.767783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f38e-1f09-4f30-a5a4-17e20b20a60a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:29.767897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490f38e-1f09-4f30-a5a4-17e20b20a60a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:29.769817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 222/439] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:29.776539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:29.777352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:29.777831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:29.798320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:29.799857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:29.814138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 218/440] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:29.838484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f38e-1f09-4f30-a5a4-17e20b20a60a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:29.855168 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490f38e-1f09-4f30-a5a4-17e20b20a60a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:29.865461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:29.866251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:29.866533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:29.866827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:29.887267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:29.894098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:29.895615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 223/441] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:29.902611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:29.915474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6d25-b511-4e19-b235-d357f5967743 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:29.925548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:29.926453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:29.926961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:29.927446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:29.928394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:29.928906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:29.930780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:29.946620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 219/442] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:29.952459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:29.967927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab251388-5dd0-45a6-a8d4-d6354a7db133 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:29.982777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:29.983573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:29.983853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:29.984131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.006140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.008047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.029801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:30.031142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 224/443] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:30.037193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.051409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339579d2-6125-4ca5-8d0f-46bc7716aab7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.061519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.062433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.062934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.063400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.064327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:30.064844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.066720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.085250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 220/444] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:30.091452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.104023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b791b-99fe-4031-9ba7-721370800f29 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.113617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.114411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.114720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.115000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.131781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.134398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.153975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:30.159573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 225/445] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:30.165980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.179927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2570-5db1-44d1-8d66-a713a2c3bdeb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.191220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.192197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.192673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.193139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.194211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:30.194749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.197453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.219578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 221/446] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:30.225845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.239813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58074b3-f5ef-420d-bcc3-48f5b2bbe04c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.248996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.249782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.250052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.250323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.274704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.276562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.305893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:30.307428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 226/447] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:30.313272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.328699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513297d-0722-450a-a682-d19285a76e2d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.340967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.341934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.342461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.342973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.343934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:30.344446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.346303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.363650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 222/448] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:30.370321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.384651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca3d-08f0-406a-bfd0-e4422f6a1566 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.395126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.395945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.396224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.396497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.412016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.414027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.438329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:30.439880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:30.446196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.459688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01209-bfc1-4807-8779-487551d0d8ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.469772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.470789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.471269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.471810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.472862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:30.473485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.477531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a901647-010b-472a-9f95-8673c82d90d5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.497629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 223/450] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:30.504249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.519544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e935f-387f-4829-b8e5-8f014e4fe215 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.529605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.530493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.530796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.531070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.552716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=55aabb50c4eb46c78cdf468b3044ce46, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.555999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6586-f8ec-479f-b5d8-b4bd948cf59e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.582398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 228/451] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:30 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:30.647389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc2da-aa77-4d6f-84a2-9b3125fcc20c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.647939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc2da-aa77-4d6f-84a2-9b3125fcc20c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.648380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc2da-aa77-4d6f-84a2-9b3125fcc20c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.650428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 224/452] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:30.657302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.657592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.657870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.687792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:30.689022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:30.770326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 229/453] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:30.815757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bc2da-aa77-4d6f-84a2-9b3125fcc20c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.833684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bc2da-aa77-4d6f-84a2-9b3125fcc20c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.841841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.843047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.843502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.843996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.861722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:30.869356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:30.870938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 225/454] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:30.877645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.891788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75763fa9-a2b0-4d91-86e6-1c6e5e7cf988 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.901825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.902504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.902811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.903089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.903861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:30.904170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.905780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.925512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 230/455] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:30.934339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:30.950962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61221e47-f837-4f8c-9890-c5ae34c1cbfc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:30.957010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:30.958195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:30.958738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:30.959213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:30.971629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:30.973879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:30.998211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:30.999806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 226/456] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.005977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.018841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8ffe0-7074-48d3-8865-6c359e4bc150 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.026257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.026965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.027247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.027523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.028261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.028564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.030161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b02d5-ed55-4541-8338-2db4b83c90dd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.047893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 231/457] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.053650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.063994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c7cb-91c4-4da8-86bc-06ef803478be admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.076799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.077790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.078212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.078653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.091706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.093960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.102838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c857-bc5d-4da8-a3be-ead10444f227 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.103172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c857-bc5d-4da8-a3be-ead10444f227 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.103454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c857-bc5d-4da8-a3be-ead10444f227 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.105218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 232/458] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:31.111083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.111368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.111648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.113492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 18:34:31.114982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 227/459] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/users/glance => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.121595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.134774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213e004-c716-4d83-b8da-c55c8e0ba959 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.139648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.140104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:31.140432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.140814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.141176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.142131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.142339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:31.142555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.144523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.162278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 233/460] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:31.163567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 228/461] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.169652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.179369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e903d-f57e-4304-a429-0a8e12b72d08 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.184526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.185388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.185772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.186133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.197049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.198090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.205798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.209690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bd75-1d52-46b7-9305-d92c8604770f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.220549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.221332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.221655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.221928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.242123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:31.243271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:31.246582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 234/462] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.255864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:31.257224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 229/463] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.259340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.263520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.274589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d71e69-cc62-405e-b9d0-f93c9e3ad817 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.279455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d8634-2b6d-4d9a-bf1a-4b06ca99098d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.283509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.284207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.284480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.284745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.285478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.285773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.288649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.292039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.292741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.293011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.293321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.294126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.294424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.299903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.313698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 235/464] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.314460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 230/465] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:31.320692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.321906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.337990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f35de-3fbc-4d2a-a87d-ee6570bda06f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.340873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6b92-f949-409b-a816-152ef4831a41 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.348584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.349739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.350615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.351095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.351365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.351631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.352295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.352565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.367358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.369876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.374297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.377369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.397887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:31.407686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:31.408908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 236/466] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.409405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 231/467] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.415231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.421893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.431678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83c2a-ef6e-492c-8ca3-c4162cd857ec admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.436089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.436309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638c42-c49a-4b55-a7db-4745a82525ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.436785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.437062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.437422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.438148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.438447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.440045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.453039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.453699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.453975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.454395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.455263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.455566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.457743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.461641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 237/468] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.466075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.481526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 232/469] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.483528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139a82-7dff-454c-8739-a93ef470ef70 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.487677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.493376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.494161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.494436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.494721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.504761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665491b-e528-416a-90f3-805907cd6351 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.510370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.512398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.512616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.513284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.513565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.513841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d34f3e4c4a4244128b8d4d1ba548d270/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.526728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-957d63c4-c2c1-4996-9158-0efd908af40c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 18:34:31.532947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 238/470] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.532947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f84e-cbc5-4b81-88e8-1a23b6e7c280 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.532947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f84e-cbc5-4b81-88e8-1a23b6e7c280 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.532947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f84e-cbc5-4b81-88e8-1a23b6e7c280 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.533399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 239/471] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:31.534400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=d34f3e4c4a4244128b8d4d1ba548d270, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.537241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f38a0-a4b7-4602-b67e-94b651ececbf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.538821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f84e-cbc5-4b81-88e8-1a23b6e7c280 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.552696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f84e-cbc5-4b81-88e8-1a23b6e7c280 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.560806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 233/472] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:31 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d34f3e4c4a4244128b8d4d1ba548d270/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:34:31.560806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.560806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.560806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.600442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:31.603662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:31.683253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 234/473] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:31.696484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.697175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.697454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.697724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.698724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.699035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.701777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.707889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.723481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4884-f9ff-49a5-bad8-6525e7b6c1ac None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.734443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.737144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.737425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.737676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.750659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 240/474] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.751465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:31.757629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.759707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:31.761530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 235/475] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.769069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.774252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef5f2-0717-4a8f-be5f-545b09772b27 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.784032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.784961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.785241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.785515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.786037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146bd7-f7c8-48fa-a09e-444435eca29a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.795149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.795828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.797387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.797672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.798887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.799196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.804068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.806976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.809111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.824543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 236/476] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:31.830989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.840494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:31.842270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 241/477] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.846572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdbc95-eecc-45fa-9e64-c1de5638e531 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.848112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.848946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.849221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.849549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.849793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.860535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc1f4-25b8-4721-aba6-0d881f8f14ec admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.861043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.862924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.866098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.867080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.868135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.868633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.869620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.870189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.872089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.880615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:31.886905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 237/478] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.887240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 242/479] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:31.889098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.893848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.900355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc443-ac6b-4df4-a6ee-2d502b8a56ca admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.904120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.904771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.905046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.905309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.906042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:31.906340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.907097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8918b-676a-4996-aa3b-ebfec1b6a166 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.907988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ce718-38a9-4ac2-94d0-62b562e677ea admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.912424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.913511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.914013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.914675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.920313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 238/480] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:31.923732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a087-4c88-4ec4-94a2-4720d6267ca9 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.924016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a087-4c88-4ec4-94a2-4720d6267ca9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.924291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a087-4c88-4ec4-94a2-4720d6267ca9 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.924595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.926422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 239/481] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:31.927221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.931247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479a087-4c88-4ec4-94a2-4720d6267ca9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.942455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-2478417c-118c-40d8-8f0c-53d49fc7b160 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:31.943808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 243/482] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:31.945181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479a087-4c88-4ec4-94a2-4720d6267ca9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:31.945301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.945710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.946083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.955943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:31.956974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:31.957395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:31.957977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:31.968939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:31.970192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:31.971446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:31.971564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:31.980496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 244/483] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:31.981307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:31.988656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 18:34:31.989975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 240/484] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:31.996620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5208ba-314a-4f85-ad6f-aa5400bdd2ff None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.000981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.009701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.012423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54510c-00a1-46b4-9c43-e67e50e9fb34 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.013044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.013450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.014425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.015572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.016159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.018746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.019253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.020083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.020511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.020930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.021906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.022349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.025034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.032747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 245/485] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:32.033669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.044738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 241/486] 10.222.0.36 () {56 vars in 1160 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:32.055722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c9c0-193c-4189-8903-243b3a076349 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.055906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.056014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.056014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.056321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.056691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.060517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eecf2c-f1ed-441a-b1e2-09e2181909f1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.065283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.066262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.066702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.067150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.069223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:32.076323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:32.077795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 246/487] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:32.078471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.078886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.080919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.089061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e2b6-f912-4e77-a825-510f4ccfd245 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.093788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.094832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.095213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.095591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/c48e090bca024c92a9cf7c038d225777/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.100938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:32.102390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 242/488] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:32.107022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.113268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=c48e090bca024c92a9cf7c038d225777, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.114996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.119197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca1b5-0e7d-450d-9617-0bc7275cfbd4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.126016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.127135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.127637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.128279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.129430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.129952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.132291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.135255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 247/489] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:32 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/c48e090bca024c92a9cf7c038d225777/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:32.142590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 243/490] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:32.143534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.148677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.159569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6595-f90a-4274-894f-08b9c8945fed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.269468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fdd74-a9a4-494a-97c3-37078ce84b1f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.272717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.273526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.273873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.274148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.288263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.288940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.289222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.290044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.290819 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.291124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.292757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.296452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.298319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.312163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 248/491] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:32.318378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.322462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:32.324012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 244/492] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:32.334579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75367c88-2f73-484b-b5f0-88afb0d35c0f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.334785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.347033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.348549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.348834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.349108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.357676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e93c9e-aef4-4974-9a45-00eb7a9173e6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.366917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.369658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.370689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.371458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.371739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.372060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.372807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.373113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.374859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.386719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:32.387789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 245/493] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:32.388395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 249/494] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:32.393906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.394875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.405389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b94e1-7272-4e90-be0d-e4c4959914ce admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.406234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf6fc-44b1-4192-8058-7f5883ff7b75 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.411514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.412019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.412363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.412647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.412920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.413019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.413427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.413868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.415410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.415830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.418637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.423031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.425034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.433133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 250/495] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:32.439358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.442828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:32.444452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 246/496] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:32.450056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813a286-4b7a-4dfc-aba0-865037d8fec5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.450803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.454796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.455764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.456145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.456525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/4c9e3e4d7b9d4bf0858c4c2562eb49e1/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.461509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e27c7-ae38-4ab3-817a-19ba0d052dfd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.467871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.468557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.468834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.469111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.469951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.470428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.472140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.473183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=4c9e3e4d7b9d4bf0858c4c2562eb49e1, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.476048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.492485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 247/497] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:32.493135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 251/498] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:32 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/4c9e3e4d7b9d4bf0858c4c2562eb49e1/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:32.499579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.512942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e01c87-fbd8-445e-bbb1-1f01e0954858 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.591416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.592072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.592354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.592630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.606663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.608443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.621001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 248/499] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:32.627165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.645301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569fc-7b7d-449a-819b-0085ecdb5254 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.655632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.656501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.656782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.657057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.674864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.676880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.703463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:32.704983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 252/500] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:32.711863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.728023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575f3e8-dcd5-434f-9d72-f4f665a069cc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.734360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.735414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.735920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.736387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.737331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.737841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.744601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.758005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 249/501] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:32.764392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.780680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d3c3-61e8-40c5-9738-bd7fbbde62fc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.791096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.791904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.792192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.792505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.800156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.802128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.816792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:32.818313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 253/502] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:32.824378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.840512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec002a8-1ecd-476e-a1ad-834cac0b6b5e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.846149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.846843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.847126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.847447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.848346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.848655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.850625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ff8b-4b41-485f-b1ea-25df03967c4d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.868598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 250/503] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:32.875310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:32.887518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12772e-806d-4fe7-8f1b-1a49d9d243d7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:32.892905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:32.893649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:32.893930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:32.894208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:32.895243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=b43005d7c7ec4c14bd0708164c20fe53) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:32.895603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:32.897496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc5187-8fb5-4e27-bdaa-505749cd0279 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:32.912602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 254/504] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:32 2021] GET /identity/v3/role_assignments?user.id=b43005d7c7ec4c14bd0708164c20fe53&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:33.585868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e3d5-63ab-4bf2-bce1-e91d3aa17270 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.587170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e3d5-63ab-4bf2-bce1-e91d3aa17270 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.587683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e3d5-63ab-4bf2-bce1-e91d3aa17270 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.589902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 251/505] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:33.595773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.596059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.596332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.623527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:33.625113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:33.633548 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 255/506] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:33.684029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34e3d5-63ab-4bf2-bce1-e91d3aa17270 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.700049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34e3d5-63ab-4bf2-bce1-e91d3aa17270 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.704818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.705851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.706332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.706828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.720837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:33.727993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:33.729705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:33.736391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.745788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b88b9-9f1f-4a8a-ba58-3bdb0413a9e7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.754576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.755496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.755997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.756469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.757456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:33.757958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:33.760537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:33.769729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 256/508] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:33.775628 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.785710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd958-20d1-48d3-b291-7047b258d056 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.794621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.795641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.796143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.796631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.808188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:33.810312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:33.835467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:33.837140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 253/509] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:33.843370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.854174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03dd0-4a16-431a-9e0a-04b16a1c138e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.862613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.863549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.864051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.864520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.865455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:33.865956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:33.867828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:33.885496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 257/510] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:33.891295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.901716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed035-a37a-4000-8624-f618ba266be6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.915382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.916173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.916454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.916725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.927889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:33.929990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:33.953920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:33.955134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 254/511] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:33.961335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:33.971267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61edecc-309e-4b09-9162-1d62a98cd23d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:33.981614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:33.982303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:33.982606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:33.982885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:33.983743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:33.984048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:33.985890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.009227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 258/512] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.015221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.028150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178478-0f42-43bd-9f9c-652c1119c858 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.034761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.035453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.035732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.036064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.046041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.047896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.060394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 255/513] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:34.066436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.077591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35f633-9bb3-4fa9-89f9-dece3cbbd1bc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.083626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.084405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.084727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.084997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.099727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.101546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.123390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:34.124900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 259/514] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.131391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.144551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926fe2d-e21c-46bb-80a8-ea18fa84fb5b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.155679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.156334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.156613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.156882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.157620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.157929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.159543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.184472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 256/515] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.190178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.200301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13c89-4825-40e5-b678-79c9e015014e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.211010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.212700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.213195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.213685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.225826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.228244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.249410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:34.255242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 260/516] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.262379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.279690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445334c-c1dc-4a6c-959d-669ee7cc1a7e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.291188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.291855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.292132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.292401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.293204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.293510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.295383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adcf12-8937-4692-9117-4bc410568305 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.313058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 257/517] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.319334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.329932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805427-666f-4395-b72f-e74ad2351087 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.345055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.346026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.346511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.347012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.348047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.348558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.350676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bef7b2-9946-4e94-95b8-cc89dac059e3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.357513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 261/518] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.418228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30c07-da75-47f5-ba67-1ef762081d85 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.418615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30c07-da75-47f5-ba67-1ef762081d85 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.418801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30c07-da75-47f5-ba67-1ef762081d85 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.421021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 258/519] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:34.427840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.428139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.428406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.451697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:34.452936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:34.466702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 262/520] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:34.486653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30c07-da75-47f5-ba67-1ef762081d85 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.507435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30c07-da75-47f5-ba67-1ef762081d85 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.513476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.514688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.515176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.515647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.543153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:34.550530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:34.556809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 259/521] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.563044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.576024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423673-8035-4c18-b0cb-a8976895627b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.588486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.589164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.589445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.589715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.590486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.590814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.592404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.609054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 263/522] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.615067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.625596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb405b5-82fc-404a-a028-33efde302a5b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.638354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.639505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.640017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.640488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.657348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.659555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.689549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:34.691500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 260/523] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.698187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.716757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3353d6-8a22-4408-9af9-e606f7ba6029 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.723827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.724749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.725255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.725728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.726708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.727740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.729534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.746858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 264/524] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.752930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.764632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8943-6719-48c7-acc2-fa0602f4cd84 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.771688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.772853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.773336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.773901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.784669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.787005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.803405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 18:34:34.805459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 261/525] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.811765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.821973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42806-c780-493f-8896-2795a44518b9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.830037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.831112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.831616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.832089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.833146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.833653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.835717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053366-5065-4446-b9b9-c391d5a388da admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.854528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 265/526] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:34.860485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.871052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb42c1-978a-4e02-a0cb-11ba76cb027b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.878093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.879038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.879519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.879987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.888925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.891317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a351-615b-42b6-8452-d65d47c63def None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.891850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a351-615b-42b6-8452-d65d47c63def None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.891954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.892789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a351-615b-42b6-8452-d65d47c63def None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.895090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 266/527] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:34.902098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.902374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.902688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.905466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 262/528] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:34.912216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.921945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426413c7-e1b1-4bba-abe3-0b79da9a2c4e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.927368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.927610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:34.928632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:34.928912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.929517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.930594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.937394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 267/529] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:34.942690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.944832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:34.962804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:34.963231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.964782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 263/530] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:34.970404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:34.972917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff818d-dfff-4352-8be4-388d9783366f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.977976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.978566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.978969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.979350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.982886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fbb7e-d4a8-40da-8bbd-c9dcb35a08ea admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:34.988689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:34.989690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:34.990368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:34.990867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:34.991054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:34.993126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:34.993575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:34.995584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.000027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:35.001650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 268/531] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:35.008798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 264/532] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.009214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.015431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.019508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4d6d-b163-410c-bc2d-9e7d3fdbf088 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.026335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.027098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.027451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.027794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.028602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8cc82-ef5d-4cba-9c99-14e288c1f863 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.028710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.029008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.030727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.034111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.035593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.036047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.036595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.041757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 269/533] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.045724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.047750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.048323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.059760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fad8c-499d-48fd-8f83-39fd1dd2c168 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.065547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:35.066176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.067075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.067427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.067643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 265/534] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.067812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.073865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.079030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.080948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.086036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faea0-4333-49cb-be8a-4e4f2638d111 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.092305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.093122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.093541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.093950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.094936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.095463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.097436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.100785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:35.102334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 270/535] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.108377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.111034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 266/536] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.118343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.128372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018374f-8a87-414b-8555-232326cb5169 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.130782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa30d5-3120-473a-a7a7-07b51c6a0cae admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.133384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.134427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.135215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.135640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.136810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d34f3e4c4a4244128b8d4d1ba548d270) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.137280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.139598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.141260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.142186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.142313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.142690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.143506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.144175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.145515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.148103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 267/537] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/role_assignments?user.id=d34f3e4c4a4244128b8d4d1ba548d270&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.160618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 271/538] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:35.166636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.177240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206367d-b132-47d0-adf3-4654c24df9b5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.182249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.183327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.183759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.184180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.193247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.196153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.210796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 18:34:35.212435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 268/539] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.219006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.240224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310f8c4-5bb4-43d7-8c1d-abdd2a78f6db admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.256480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.257323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.257677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.258622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.259633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.260272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.262233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.284972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 272/540] 10.222.0.36 () {56 vars in 1158 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.291494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.301765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6833-8067-4df6-b4d8-fdf0497e4532 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.306632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.307546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.307966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.308371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.317429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.319591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.331364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 269/541] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:35.337680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.348667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14523fc9-f729-4020-bf72-fb0c937c276c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.354056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.355155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.355605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.356015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.368929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.371136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.390641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:35.392487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 273/542] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.398759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.408394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf29f-ea5e-40b7-a9c1-64289e95af2c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.413190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.414046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.415080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.415490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.416423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.416862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.418708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.433315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 270/543] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.439224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.449495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6fffa-8bd3-47ef-b5d0-20908e6b0bb4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.453936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.454796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.455073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.455364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.462696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.464703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.478157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-211ba588-7e4b-464e-97f0-485103f1663f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:35.479645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 274/544] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.486416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.496378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95b4fb-08af-4826-a8cc-19992f1a1c7c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.501150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.501919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.503857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d549a-bc85-46c7-b148-ac9e1551ea17 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.504199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d549a-bc85-46c7-b148-ac9e1551ea17 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.504312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.504575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d549a-bc85-46c7-b148-ac9e1551ea17 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.504678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.505481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.505798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.506951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 275/545] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:35.507756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.516683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.517033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.517371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.525428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 271/546] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.534073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.538880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:35.540218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:35.546289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f02e-38e1-46d8-9dc8-715553f9d5c8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.550226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.551008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.551367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.551734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.552831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=c48e090bca024c92a9cf7c038d225777) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.553146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.554374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 276/547] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:35.558620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.561674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 272/548] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/role_assignments?user.id=c48e090bca024c92a9cf7c038d225777&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.584906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.594898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a43c-58c0-4908-b0a0-3bbce291c8a0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.599706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.600547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.600830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.601105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.615288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:35.623126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:35.624679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 277/549] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.630882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.643727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50304-db67-4764-9ab3-d53048c3f39f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.649119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.650022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.650471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.650918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.651830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.652492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.654264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.663784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 273/550] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.670394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.681963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1077c-e237-4733-9542-8453c51305d9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.688012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.689092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.689570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.689980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.704328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.706756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.728601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:35.730499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 278/551] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.737442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.749379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3f3a-7129-4451-a6b4-b01ecd5f2abb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.754508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.755537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.755983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.756394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.757324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.757779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.759836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.776676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 274/552] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.787261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.797857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de34b3-4b2a-492e-b0e7-e513396dce81 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.802538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.803415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.803695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.803964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.813980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.816042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.830380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4fd3b2b6-c023-4d49-8c0f-ab69c16749bc admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 18:34:35.832030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 279/553] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/users/neutron => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:35.838704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.848919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3889f-0432-4df8-a159-57d607c565d2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.860344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.861091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.861378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.861705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.862648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:35.863019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.864925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.896691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 275/554] 10.222.0.36 () {56 vars in 1160 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:35.898120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52df5-bc56-48de-87df-2f1963b97be3 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.899113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52df5-bc56-48de-87df-2f1963b97be3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.899279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52df5-bc56-48de-87df-2f1963b97be3 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.900999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 280/555] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:35.904377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.909699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.910160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.910612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.916172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaf71-7a8c-48b9-9aba-81f4f932854e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.922101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.922820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.923104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.923432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.933755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:35.935053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:35.935887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.937879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.944624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 281/556] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:35.950581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 276/557] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:35.955513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.965159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738aab-7895-43f1-9a85-73c1f3aebbfe None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.969994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.971002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.971384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.971808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:35.973909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:35.984394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2190ec-387f-44cf-9c12-4fd6bb5b7724 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:35.989159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:35.992730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:35.996030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:35.996932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:35.997314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:35.997717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.013837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:36.017260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:36.019047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 282/558] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:36.021564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:36.026567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 277/559] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:36.029663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.031457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.044017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c463a3-1aae-45d0-b94e-c30c0bdd57ed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.049088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3298a83-849a-4765-a03e-3ead8f95e547 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.054760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.055722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.056223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.056699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.057646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.058152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.060447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.068561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.069583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.070072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.071127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.072125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.072631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.074430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.087254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 278/560] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:36.094698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 283/561] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:36.095798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.100874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.106194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5bbb-b709-44c6-a902-5418cf0940ff admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.111933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d12c-68f7-4e2a-9532-1e63ea53c255 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.117582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.118651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.119137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.119612 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.128612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.129649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.130158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.130679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.132079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.135233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.158038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:36.159448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.159836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 279/562] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:36.161284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.173769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.182770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:36.184794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d5d2-da56-4025-ad40-d058161dfedd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.186695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 284/563] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:36.198040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.203942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.204608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.204888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.205163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.205969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.206276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.208150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.217505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a107-05cb-4260-8f38-1bdbd73be067 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.225815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.226467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.227297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.227575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.228312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.228615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.230210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.233476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 280/564] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:36.245255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.256203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511a38a-3354-4772-87d1-73a4de8b2183 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.259703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 285/565] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:36.268194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.270466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.271175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.271456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.271755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.272592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=4c9e3e4d7b9d4bf0858c4c2562eb49e1) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.272902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.274900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.287082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84767-52e6-4147-a3f6-3e95a7d8072e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.288952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 281/566] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/role_assignments?user.id=4c9e3e4d7b9d4bf0858c4c2562eb49e1&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:36.303441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.304263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.304546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.305350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.313557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.315757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.330909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:36.332459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 286/567] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:36.339382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.361255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d46f-a67c-46ea-a3b5-483bd0ec8b3b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.375443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.376137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.376399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.376674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.377546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.377853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.379818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.406624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 282/568] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:36.412440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.422703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df906df-8862-4efc-aa7b-337b0bbe5868 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.440803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.441609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.441886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.442154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.453731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.455680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.474294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:36.476058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 287/569] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:36.482078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.501169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f08c-924b-4e77-b613-7c4d5f8b65ce admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.515321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.516005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.516283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.516556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.517309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.517609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.519259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.536132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 283/570] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:36.542108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.557859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa6c-734a-4201-8d89-82994a1300f8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.564757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.565613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.565892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.566218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.573957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.576043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.591457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:36.592942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 288/571] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:36.599360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.614069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892483b2-3c4a-4b0c-b412-50db21836488 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.620367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.621277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.621775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.622197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.623176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:36.623632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.625685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a3264-9c3b-4ab4-af52-d18a098ec52c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.641613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 284/572] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:36.648289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:36.659751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96a46-fb52-4ef6-9208-40e787d7d892 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:36.664571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:36.665596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:36.666045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:36.666464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/b43005d7c7ec4c14bd0708164c20fe53/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:36.682305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=b43005d7c7ec4c14bd0708164c20fe53, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:36.685209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6a610-8ecd-4afe-a4b8-926b629c4c01 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:36.703523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 289/573] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:36 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/b43005d7c7ec4c14bd0708164c20fe53/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:37.491580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1ecf-28eb-4c9c-913f-40c1eb4c1b98 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.492106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1ecf-28eb-4c9c-913f-40c1eb4c1b98 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.492106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1ecf-28eb-4c9c-913f-40c1eb4c1b98 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.494180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 285/574] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:37.499967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.500363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.500543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.527461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:37.528638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:37.597307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 290/575] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:37.644005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f1ecf-28eb-4c9c-913f-40c1eb4c1b98 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.656453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f1ecf-28eb-4c9c-913f-40c1eb4c1b98 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.667750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.668540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.668815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.669084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.686356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:37.693129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:37.694491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 286/576] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:37.701537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.710620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172a7e-a048-4a11-825a-c113f9184a9c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.718655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.719312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.719587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.719855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.720733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:37.721038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:37.722631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:37.731783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 291/577] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:37.737911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.747679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3a10-030a-43da-b799-481cc5fc3dad admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.754707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.755483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.755758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.756026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.774331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:37.776190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:37.796820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:37.798215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 287/578] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:37.805474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.815707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da4b0e-c62c-4236-91b0-7e0996bb1045 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.828087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.828749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.829026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.829296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.830034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:37.830333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:37.831964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:37.844791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 292/579] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:37.850890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.860629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156fa0-58a5-4b9a-bb14-45b68f6e5737 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.871457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.872225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.872532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.872770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.885554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:37.887612 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:37.906714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:37.907957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 288/580] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:37.914230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.924030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4454-236e-4b4c-afd8-d7be1b1a6b21 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.934722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.935389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.935666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.935934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:37.936784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:37.937086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:37.938939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:37.956611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 293/581] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:37.963539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:37.984277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5359-9113-4cdc-8cf6-614ec17ce57f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:37.990534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:37.990771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:37.990948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:37.991212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.005430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.007187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.019946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 289/582] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:38.027018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.036714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4117c09-4ba1-491e-9c7c-e663ca2cdf71 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.046558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.047319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.047591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.047857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.059010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.060834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.087335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:38.088858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 294/583] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:38.094752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.103764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2627-4db3-4a9a-97dd-cf81f6404635 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.112550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.113207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.113484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.113754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.114485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.114806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.116379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.134824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 290/584] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:38.141312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.152363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec820-5534-435c-a44e-5fd78aeefec0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.162665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.163486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.163759 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.164029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.171684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.173638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.198598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:38.200165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 295/585] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:38.207131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.236813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a422c9b-8614-4f60-a0c4-4e9b29d48431 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.249877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.250560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.250850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.251122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.251916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.252217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.254036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927185ef-4ff1-43d3-87e6-05d4d38a2f2e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.271653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 291/586] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:38.278197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.293502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec80e-029d-425a-8166-53bfd27d53e7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.307083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.307751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.308033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.308201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8734ac-ebd9-4e98-bc7d-2ae1c19357f1 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.308405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.308566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8734ac-ebd9-4e98-bc7d-2ae1c19357f1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.308721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8734ac-ebd9-4e98-bc7d-2ae1c19357f1 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.309149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.309461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.310690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 292/587] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:38.311330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.317489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 296/588] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:38.323939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.324236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.324487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.353262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:38.354617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:38.372151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 293/589] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:38.412860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.423831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461300b8-f43d-41e6-81da-504fd97416d7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.435046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.435849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.436132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.436411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.452541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.454424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.476530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-ccfd42ff-5392-4b6a-8c52-bbe4653e220c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:38.478272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 297/590] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:38.484730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.496982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07639c8f-9498-4237-ae7d-75126f6541fc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.504012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.504675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.504955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.505221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838612-f1b4-4925-ad85-80380e73e09f None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.505704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.505855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838612-f1b4-4925-ad85-80380e73e09f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.505855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838612-f1b4-4925-ad85-80380e73e09f None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.506151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.506297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.507649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 298/591] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:38.507836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.513805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.514065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.514329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.528300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 294/592] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:38.533409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:38.534216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.534631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:38.543532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 299/593] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:38.553127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdcf5-d090-4f1e-afe8-291eb5975755 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.568444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.568764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.569126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.569409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.569685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.570456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.572410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.578228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410d3b-0579-4589-b275-2a7b87e67e2d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.583020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.583865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.584309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.584510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.585120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.586889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:38.586889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:38.586889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:38.587841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.603573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 18:34:38.605206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 300/594] 10.222.0.36 () {56 vars in 1150 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:38.611750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.615490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 295/595] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:34:38 2021] POST /identity/v3/users => generated 254 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:34:38.622649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949656a-c7e9-417a-8b53-e14533a4faab admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.627557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.628230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.628558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.628830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.629761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.630069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.631176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:38.631176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:38.631176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:38.632095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3cff-69dd-4942-b11c-31fbe5fd3fca admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.638155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 301/596] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:38.644535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:38.657539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210e8f-2898-483f-be8f-d321c11cfda4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:38.662915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:38.663975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:38.665048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:38.665517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:38.666477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:38.666990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:38.668283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:38.668283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:38.668283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:38.669523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a93c-a021-4a02-943e-7bc31e027498 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:38.676797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 296/597] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:38 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:39.506808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5cf9-8dcb-4cf2-bc22-46700a58e700 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.507845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5cf9-8dcb-4cf2-bc22-46700a58e700 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.508390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c5cf9-8dcb-4cf2-bc22-46700a58e700 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.511235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 302/598] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:39.517700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.518188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.518261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.546709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:39.547916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:39.558830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 297/599] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:39.598395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5cf9-8dcb-4cf2-bc22-46700a58e700 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.620196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c5cf9-8dcb-4cf2-bc22-46700a58e700 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.624736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.625522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.625801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.626071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.646712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:39.654113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:39.655619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 303/600] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:39.662035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.673923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c803b5-a18b-4e62-9b4a-ad72f15edb2d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.682804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.683476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.683750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.684022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.684777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:39.685080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.686680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3245c-7621-4bb4-b946-a74064776c45 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.702047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 298/601] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:39.707768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.723459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27207-8847-46a2-97ff-e771ac6ff4a8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.731251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.732020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.732300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.732593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.754234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.756122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.764873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186c2-a864-4406-ab76-7f7952b65f6f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.765438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186c2-a864-4406-ab76-7f7952b65f6f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.765720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186c2-a864-4406-ab76-7f7952b65f6f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.768262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 299/602] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:39.784638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-40750ab2-379c-4e49-9273-144b9ec6c32c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:39.786121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 304/603] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:39.792798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752186c2-a864-4406-ab76-7f7952b65f6f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.794789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.795073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.795348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.816571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752186c2-a864-4406-ab76-7f7952b65f6f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.825904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.826584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.826868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.827140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.827981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:39.828287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.829875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.831942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:39.833146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:39.848984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 305/604] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:39.851257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 300/605] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:39.864609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.874584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a71e51-c502-4353-af7b-2e575caae7c7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.878117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.883861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.884788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.885381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.885743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.891409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a00433-5a2e-4b79-9358-f32b7faffacf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.899513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.902265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.903197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.903474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.903746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] PATH_INFO: `/v3/services/network` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.905082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.906007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.907313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:39.907313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:39.907313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:39.909629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.933730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:39.935375 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 306/606] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:39.936873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 18:34:39.938329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 301/607] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/services/network => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:39.945999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.947565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:39.958881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9f08-6ee2-4efd-8166-2faf5f0f5f01 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.961153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3545-cabb-4621-aef4-6f12e0603116 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:39.969009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.969736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:39.970505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.971252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:39.971629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.972009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:39.972380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.972749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:39.973580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:39.974557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:39.974964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.975374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:39.977614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.979586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:39.991548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 302/608] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:39.998732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.018291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65f4c-bc1b-4f46-9307-7add1671e2b9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.023295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 307/609] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:40.026629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.034272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.035081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.035463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.035835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.036662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] RBAC: Adding query filter params (type=network) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:40.037069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.038794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.046034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272de55-ee4e-46e4-8464-b6529a1d11a1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.048698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 303/610] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:39 2021] GET /identity/v3/services?type=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:40.059189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.059995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.060381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.060756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.069562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.071620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.082147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 308/611] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:40.093220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.105056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3da9-531f-497c-8855-4925646ee704 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.110272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.111737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.111737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.112014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.125012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.127227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.145053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:40.146839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 304/612] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:40.153831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.163186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79360923-5f2a-4602-adc2-c561d63dfad7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.168118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.168954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.169342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.169719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.170626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:40.171042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.172938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.187680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 309/613] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:40.194091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.204037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f60faf-7a1a-4d40-bf13-ea52941b2d92 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.208685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.209566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.209854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.210184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.218735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.220826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.235145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:40.236706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 305/614] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:40.243797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.253706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee44f-aa73-4d2e-b930-cceb8e768dee admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.259120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.259781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.260378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.260655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.261464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:40.261773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.263770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53daa3-1e9b-4d0e-993a-6d44654be52b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.284023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 310/615] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:40.290638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:40.303266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8526-d1aa-490d-888f-f40ada40aa9d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:40.310082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:40.310857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:40.311142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:40.311467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:40.312322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=b43005d7c7ec4c14bd0708164c20fe53) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:40.312686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:40.314722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357811-f4a7-4303-b83c-76e452b7fe3d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:40.321858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 306/616] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:40 2021] GET /identity/v3/role_assignments?user.id=b43005d7c7ec4c14bd0708164c20fe53&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.120062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768309-d194-4bac-98e0-e2bb719c5fa5 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.120062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768309-d194-4bac-98e0-e2bb719c5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.120062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768309-d194-4bac-98e0-e2bb719c5fa5 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.120062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 311/617] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:41.128115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.128115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.128115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.151534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:41.152949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:41.157197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8637613-fc04-4281-acf6-45b3f1a30ad0 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.157490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8637613-fc04-4281-acf6-45b3f1a30ad0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.157767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8637613-fc04-4281-acf6-45b3f1a30ad0 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.159821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 312/618] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:41.163839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 307/619] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:41.165842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.166227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.166630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.194630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:41.196367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:41.215514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.215922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 313/620] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:41.227977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724c21f-20a0-41d5-b443-5df5b4588da8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.238193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.239238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.239601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.239907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.240346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.252017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4101c1-3cb6-4181-9aa8-b0f8133406ae None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.263736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:41.270935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.271603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.271877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.272148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.272902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.273969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:41.273969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:41.273969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:41.274891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.277650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:41.278897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 308/621] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:41.287402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.298453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a23988-cb95-407e-877c-5a72536ecee7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.306723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 314/622] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:34:41 2021] POST /identity/v3/services => generated 251 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:41.323149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.323859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.324145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.324416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.325240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:41.325544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.327351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.336960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 309/623] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.343542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.363680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f1f7-9fe5-4ccf-a8cd-8b552c430295 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.371580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.372381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.372660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.372933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.394886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.396721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.425020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:41.430699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 315/624] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:41.433155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.446708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304c19-27c1-4251-9f68-cfaa07b02f0f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.458363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.459129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.459408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.459686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.460444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:41.460755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.462560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.480303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 310/625] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.487043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.499560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d7e65-4e80-4922-844a-ca0c497d7323 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.508802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.509523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.509801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.510326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.523996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.526024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.546346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:41.548033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 316/626] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:41.554089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.568095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc486f5d-f6ae-4019-ba7b-bccdad154d2c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.577171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.577865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.578141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.578410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.579547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:41.579860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.581752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.606310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 311/627] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.612747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.628243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308b99f-abfb-4e43-b3a6-b4d8505d8e5f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.636761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.637583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.637858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.638125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.653326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.655246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.674264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:41.675848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:41.682281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.692227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842012-6de1-4647-8483-425dcaac1da7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.698225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.698916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.699195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.699467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.700207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:41.700508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.702108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.715273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 312/629] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.721899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.732245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eb06-7c8e-4e5a-9c59-5be5a855d35a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.736891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.737677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.738016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.738289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.746510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.748557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.762671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-01847fd5-14e6-421a-bcb1-0f2d8b3c0001 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:41.764172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:41.772167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.783671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b7be-e3c6-49ea-a3d3-14d79fcf4068 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.784399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d09-6eb5-410d-8fcf-14ed67028316 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.784735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d09-6eb5-410d-8fcf-14ed67028316 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.784965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72d09-6eb5-410d-8fcf-14ed67028316 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.787471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 319/631] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:41.793305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.794250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.794705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.794965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.795064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.795273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.795713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.796702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:41.797199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.799403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.818264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:41.818645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 313/632] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:41.819973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:41.828128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.834207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 320/633] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:41 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:41.844937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c273-bc2c-4c6a-b4cc-8696b9011d17 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.849491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.850361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.850661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.850932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.853003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=55aabb50c4eb46c78cdf468b3044ce46, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:41.857108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:41.863592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:41.873961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 314/634] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:41 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:34:41.875899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85bd8f-8421-448b-b1c3-6eed6910b092 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:41.944585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:41.946367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:41.946896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:41.947379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:41.967734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:41.975370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:41.977576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 321/635] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:41.984433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.000627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5e0-3140-49b2-809a-d42000e83e3d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.016745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.017334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.017607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.017874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.018661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.018963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.020638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.029941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 315/636] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.036290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.054579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39d665-aa34-4c3c-8ee3-5e0901fa5aa8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.060113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.061257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.061725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.062179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.083465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.085641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.108435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:42.110286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 322/637] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:42.116651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.132108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec603239-e1a6-4022-a1b7-4badfa73b86b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.147191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.147946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.148294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.148697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.149505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.149875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.151601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.166069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 316/638] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.172169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.187800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f7e8-90de-4bf4-b653-d4d4fe8a17bf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.199169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.200174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.200647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.201065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.209458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.218568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.233689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:42.243406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 323/639] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:42.249913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.263370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02fb9-5b6f-4876-bf08-2a03674e7983 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.279254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.279941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.280286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.280625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.281539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.281925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.283842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.306480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 317/640] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.312444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.327425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076aeae-babb-4bc7-b415-2d75e3f302c8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.336573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.337454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.337915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.338367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.348513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.350490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.364149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 324/641] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/auth/tokens => generated 1171 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:42.370708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.383490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f449aa2-4234-4154-8e36-d338b2b71919 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.390626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.391411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.391680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.391945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.409506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.411427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.444854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:42.447173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 318/642] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:42.453031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.466320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80f3f-078f-4e13-885f-55e9c4bb588e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.472818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.473753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.474255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.474760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.475698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.476246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.478198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.497870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 325/643] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.503638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.519407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63da5-0342-40dc-887c-ff795219c285 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.527728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.528504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.528775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.529041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.541066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.542974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.563833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:42.565320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 319/644] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:42.571359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.584122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62160e-7fe7-4472-818f-a5e647a0d81a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.600085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.601102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.601638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.602166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.603246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.603772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.605832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a8d70-c307-4474-bd19-3bc231593117 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.627744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 326/645] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.634371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:42.644921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d316-82a3-4eb7-bb20-4a1792c0a813 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:42.656974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:42.657611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.657882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.658150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.659008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d90d673d13f1441e8fc551b7d0fe7f4a) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:42.659313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:42.661130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1f830-45e5-42eb-97dc-758df8eb5718 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:42.667140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 320/646] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:42 2021] GET /identity/v3/role_assignments?user.id=d90d673d13f1441e8fc551b7d0fe7f4a&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:42.925835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79c82a-ce39-4872-a182-272a8e08d5f9 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.926579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79c82a-ce39-4872-a182-272a8e08d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.927073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79c82a-ce39-4872-a182-272a8e08d5f9 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.929548 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 327/647] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:42.935676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e407c-8840-4f95-a1aa-72c6d1defda0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:42.936224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e407c-8840-4f95-a1aa-72c6d1defda0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:42.936702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e407c-8840-4f95-a1aa-72c6d1defda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:42.963687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fd7e407c-8840-4f95-a1aa-72c6d1defda0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:42.965329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fd7e407c-8840-4f95-a1aa-72c6d1defda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:42.974106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 321/648] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:42 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:43.011302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79c82a-ce39-4872-a182-272a8e08d5f9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.027643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79c82a-ce39-4872-a182-272a8e08d5f9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.035837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.036510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.036788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.037061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.037800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.039454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34082f-66b9-483e-a0b8-e0f7ef73db66 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.064515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 328/649] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:34:43 2021] POST /identity/v3/services => generated 240 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:43.432434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b4b6d-a643-4841-a40a-2ce323590e56 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.433461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b4b6d-a643-4841-a40a-2ce323590e56 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.433952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b4b6d-a643-4841-a40a-2ce323590e56 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.436323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 322/650] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:43.442179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.443064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.443551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.462936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:43.464496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:43.497152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 329/651] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:43 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:43.522942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b4b6d-a643-4841-a40a-2ce323590e56 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.536286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b4b6d-a643-4841-a40a-2ce323590e56 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.542443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.543513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.543993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.544462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.556215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:43.563342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:43.565114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 323/652] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:43.572340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.581867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324796c3-93a0-4a2a-9a0c-e8bf620fadbe None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.589085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.589736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.590012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.590282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.591084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:43.591387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.592975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.602226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 330/653] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:43.608389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.620405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8c04-44b4-4c3b-836c-b965109a6ab6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.627491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.628280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.628562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.628844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.646323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.648204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.670247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:43.671781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 324/654] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:43.677937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.696308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19aeb-41aa-4f15-992d-8a8d4461abdf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.707070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.708076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.708604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.709264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.710203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:43.710732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.713517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.737190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 331/655] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:43.743876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.760349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969f8-53f5-4a26-8547-f497282fa9bb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.770737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.771536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.771811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.772079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.787586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.789935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.803992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:43.806474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 325/656] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:43.817279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.835980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cad2-9f43-46f1-a166-08127b73d132 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.846772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.847687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.848073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.848448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.849676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:43.850104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.852938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.890919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 332/657] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:43.899092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.911589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f47778-86a2-4ceb-a704-ea2552998c9b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.920012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.920938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.921431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.921903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:43.937847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:43.939943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:43.950273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 326/658] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:43.956099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:43.973411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774c52-b40b-4c8e-bd04-cbb396e74a39 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:43.988213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:43.989005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:43.989280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:43.989559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.007213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.010263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.043989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:44.051014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 333/659] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:44.053692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.078402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d3608-feaa-4a06-98ac-71838fe442fc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.091810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.092480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.092757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.093026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.093768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.094070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.095684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.120761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 327/660] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.127689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.150446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e07c7-8b2b-4dfb-bb3c-b6703c2a2c88 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.158684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.159464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.159745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.160016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.175785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.178392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.206252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:44.208233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 334/661] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:44.216940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.240808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd0297-7849-4ef9-889c-8246e3d0a355 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.249057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.249718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.249995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.250266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.251087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.251396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.253224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548a809-a602-4162-b103-f1114d54674e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.271829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 328/662] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.281137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.301177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b05244-d970-462b-a450-c3d04a2d70b8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.311741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.312620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.313005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.313378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.314611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=b43005d7c7ec4c14bd0708164c20fe53) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.315053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.317756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1b190-18a6-47ea-bdea-8a43a2a4a586 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.332932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 335/663] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/role_assignments?user.id=b43005d7c7ec4c14bd0708164c20fe53&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.486859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1727-680b-4d1a-8b0b-24c9115f9841 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.487876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1727-680b-4d1a-8b0b-24c9115f9841 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.488385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1727-680b-4d1a-8b0b-24c9115f9841 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.490712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 329/664] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:44.497257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.498164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.498744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.518082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:44.519714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:44.528444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 336/665] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:44 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:44.552604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1727-680b-4d1a-8b0b-24c9115f9841 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.566088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1727-680b-4d1a-8b0b-24c9115f9841 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.571255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.572427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.572950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.573429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.574360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.576271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.589438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 18:34:44.591318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 330/666] 10.222.0.36 () {56 vars in 1150 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:44.598331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.608373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f1176-ca1d-4aad-ba06-18f5a78ec7e3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.613325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.614289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.614798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.615282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.616281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.616846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.619519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.625601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 337/667] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.632608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.643713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d5b0d-a6be-44c9-8903-418cffd2579f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.651588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.652283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.652564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.652831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.653623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.653942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.655841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.662318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 331/668] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.672028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.682745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a02-50c8-49ab-bc88-0d67eba18fb8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.687673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.688711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.689174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.689628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.690673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] RBAC: Adding query filter params (interface=public, service_id=1303d3264d1149049e245947855660ab, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:44.691211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.692446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:44.692446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:44.692446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:44.693657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd0d6-0768-457d-920a-97b60f4eb5d3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.702303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 338/669] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/endpoints?service_id=1303d3264d1149049e245947855660ab&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.708743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.719476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830b34f-6c08-4f94-a18f-9c4dc65008f1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.724356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.725219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.725758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.726230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.727691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:44.729561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875c02-e9ba-435a-b238-041492c89f98 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:44.735527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 332/670] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:44.836404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d1c-f9eb-46ad-8e3a-ddda0ad81749 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.836989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d1c-f9eb-46ad-8e3a-ddda0ad81749 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.837473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319d1c-f9eb-46ad-8e3a-ddda0ad81749 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.839817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 339/671] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:44.846393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.846702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.846978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.865626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:44.866858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:44.875455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 333/672] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:44 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:44.910886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319d1c-f9eb-46ad-8e3a-ddda0ad81749 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.924370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319d1c-f9eb-46ad-8e3a-ddda0ad81749 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:44.933904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:44.935094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:44.935708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:44.936169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:44.954578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:44.962148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:44.963779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 340/673] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:44.973193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:44.994023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4c311-a7d7-4805-a72b-32a2e97a48b7 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.001717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.002432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.002744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.003063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.003881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.004186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.005900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.020387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 334/674] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.028422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.040361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aae69-da17-4c67-b53a-c2ee1713f29e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.045656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.046597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.046960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.047343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.059147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.061182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.081495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:45.083078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 341/675] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:45.089301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.099188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cdb75-7b10-4aeb-a7dc-bd425a4c2b03 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.105629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.106531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.107055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.107531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.108488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.109013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.110845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.126018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 335/676] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.132380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.142799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235d782-3794-4389-95f1-0602d4c1dc03 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.147734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.148864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.149358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.149835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.158535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.160938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.177547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:34:45.179441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 342/677] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:45.185883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.196759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65bff1-1260-48e3-90eb-9feb765fd370 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.205842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.206794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.207311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.207787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.208847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.209366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.211523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.230257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 336/678] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:45.236649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.246807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360064ed-1fe7-481d-be88-46f8781b0122 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.251740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.252640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.253123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.253597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.263009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.265032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.274619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 343/679] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:45.281049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.291276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1c243-7919-4cec-ab9c-e4dde631fa8b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.296262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.297348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.297831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.298333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.310011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.312185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.329882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:45.331826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 337/680] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:45.338805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.348009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08284a3-5c4a-47e8-bbd0-0d331de20e03 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.352899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.353807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.354294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.354889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.355827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.356351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.358126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.370823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 344/681] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.377179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.387731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0a6e0-955f-45db-a90f-91323c0f6dc6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.392588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.393611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.394113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.394616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.402741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.405022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.418812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:45.420595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 338/682] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:45.427178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.437697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3d2d-36dc-4726-bbe8-af77ab9941b3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.442492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.443474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.443955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.444424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.445477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.446006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.448206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae6cd7-e0a5-43b7-82bb-57ad5bae105c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.461925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 345/683] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.469064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.481458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4256b-32c4-49c5-9993-4700dd81bd5c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.486420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.487311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.488234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.488714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.489817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.490359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.493028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689390d-6bf9-4c61-a62b-667dd5df08a5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.499797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 339/684] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.690121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7258e-a810-4d10-9ba0-aa7b96e3d119 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.691106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7258e-a810-4d10-9ba0-aa7b96e3d119 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.691620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7258e-a810-4d10-9ba0-aa7b96e3d119 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.693904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 346/685] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:45.700409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.700990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.701488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.722642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:45.724221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:45.733809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 340/686] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:45 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:45.764304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7258e-a810-4d10-9ba0-aa7b96e3d119 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.782260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7258e-a810-4d10-9ba0-aa7b96e3d119 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.788433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.789756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.790038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.790311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.801169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:45.812415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:45.813950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 347/687] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:45.821083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.836018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5586d-689f-4f5d-b5a5-218d8608e19b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.841038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.841962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.842506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.843008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.844023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.844546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.847209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.857270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 341/688] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:45.863282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.877487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8e84-593e-4667-a5ce-3a5c7efb12e1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.882525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.884127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.884647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.885417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.897075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.899423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.916891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:45.918773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 348/689] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:45.927123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.937856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12557-b065-49b9-bdbf-b3fa0aa1a5ca admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.942522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.943163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.943442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.943717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:45.944459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:45.944765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:45.946573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:45.960656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 342/690] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:45.966912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:45.982737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d097-aa3c-43bc-a70b-68cf9d94676b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:45.993216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:45.994285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:45.994808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:45.995285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.005009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.007468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.024851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:46.026719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 349/691] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:46.032707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.049119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf067-68f4-4c63-af02-f61f29e9ea43 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.059125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.060271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.060783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.061278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.062183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.062495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.064368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.091178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 343/692] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.098528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.111180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003caa0-efd3-464c-ae07-34278bcd7fdd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.115808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.116653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.116933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.117775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.133732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.135854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.168220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:46.170111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 350/693] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:46.176082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.190423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00eb8-44e8-4a16-8834-edfc17846dd5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.199857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.200461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.200745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.201068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.201815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.202118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.203795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.222456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 344/694] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.228813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.244043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d353-2098-4751-9892-3e4358e3bfa9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.251166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.251952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.252233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.252507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.271668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.274161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.298071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:46.299645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 351/695] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:46.306220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.320644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052bb13-be8d-40b0-870b-4b3117d69b46 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.331457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.332388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.332795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.333107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.334018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.334320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.337168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabff530-d4b5-421e-bb6b-c1bb5122a58b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.365077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 345/696] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.372358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.389825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210d36-c9ae-4af6-9071-3755453411a3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.400840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.401739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.402016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.402286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d90d673d13f1441e8fc551b7d0fe7f4a/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.434533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=d90d673d13f1441e8fc551b7d0fe7f4a, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.437197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634804-b2a0-42d1-942e-adf4757d5b1f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.459129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 352/697] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:46 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d90d673d13f1441e8fc551b7d0fe7f4a/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:34:46.616022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b701ff-a1b5-4548-a344-5544ec8b34c5 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.617079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b701ff-a1b5-4548-a344-5544ec8b34c5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.617640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b701ff-a1b5-4548-a344-5544ec8b34c5 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.620091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 346/698] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:46.626706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.626993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.627267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.655751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:46.656996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:46.734786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 353/699] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:46 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:46.773185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b701ff-a1b5-4548-a344-5544ec8b34c5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.785995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b701ff-a1b5-4548-a344-5544ec8b34c5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.792211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.793241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.793724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.794212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] PATH_INFO: `/v3/services/network` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.795126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.796912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.809583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 18:34:46.811597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 347/700] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:46.818636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.828300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeda2b-bf7e-4c35-a79e-0f88061957d9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.833163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.834130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.834637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.835113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.836697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.837225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.839164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.844561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 354/701] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.850932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.861254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240444d8-5984-4480-bcd9-ee27fc6cf433 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.866058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.866971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.867977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.868450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.869405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.869910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.871865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.880779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 348/702] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.888044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.899814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908b184-0507-45ac-a77b-9bf55ee819f1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.905648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.906579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.907085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.907562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.908593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] RBAC: Adding query filter params (interface=public, service_id=1d4c850910234b8dbaecdb2f6a529aa8, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:46.909107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.910947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389bcc5-d050-4cd6-bd91-767bad94e47d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.917260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 355/703] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/endpoints?service_id=1d4c850910234b8dbaecdb2f6a529aa8&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:46.923606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:46.934511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dae80-1b81-48ab-a4d0-a251da5a33e5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:46.939302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:46.940288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:46.940808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:46.941284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:46.942520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:46.944500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3ec95-3d97-4cf4-8d8c-6b862d2548d2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:46.951499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 349/704] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:34:46 2021] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:47.549694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962214-a35d-4638-b888-74857e626ba1 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.550410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962214-a35d-4638-b888-74857e626ba1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.550930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962214-a35d-4638-b888-74857e626ba1 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.553187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 356/705] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:47.560012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.560542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.561029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.579525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:47.581052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:47.589786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 350/706] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:47 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:47.614246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b962214-a35d-4638-b888-74857e626ba1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.627783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b962214-a35d-4638-b888-74857e626ba1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.632656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.633779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.634264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.635008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.646097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:47.654218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:47.656023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 357/707] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:47.663067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.673323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efda4-dc92-4b93-82d6-fb9d5c56545a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.678184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.679539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.680032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.680507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.681469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:47.681988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.683824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:47.693148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 351/708] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:47.699788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.710469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48cb4-5566-4f82-ad21-6683c8b6a080 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.715885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.716884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.717408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.717882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.729544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.731755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:47.749529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:47.751882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 358/709] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:47.758756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.781242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ea4d1-432a-4969-9184-7b55f64da583 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.795408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.796500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.796796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.797078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.797828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:47.798138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.799827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:47.816156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 352/710] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:47.822668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.840957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9853d-befd-4c6b-a0ae-fe4786a313f5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.846338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.847518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.848007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.848548 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.863080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.865678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:47.882094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:47.885647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 359/711] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:47.895761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.907033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21413e-cb16-48ce-9cfa-d6d6150ee6f6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.911996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.912892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.913429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.914014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.915606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:47.916140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.918190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:47.937308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 353/712] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:47.943984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:47.954538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b6f8-a010-4b15-93fc-da09de01eb6a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:47.959353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:47.960415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:47.961506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:47.961982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:47.972760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:47.980204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.004413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:48.006220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 360/713] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:48.013806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.024201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83a245-8b77-4179-973f-2ef4b048ba7c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.029016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.029938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.030424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.031004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.032026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:48.032535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.034416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048422d7-14b3-4580-8c7d-3778d2b24c40 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.047790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 354/714] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:48.054309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.065125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48d5c-0441-47e6-b5a7-8733aef149bf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.069920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.071038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.071572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.072046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.079930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.082111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa2d9-cb9e-444c-a4d3-5ae6df027775 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.082640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa2d9-cb9e-444c-a4d3-5ae6df027775 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.083121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa2d9-cb9e-444c-a4d3-5ae6df027775 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.084715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.085921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 355/715] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:48.098130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.098731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.099256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.104367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:48.105914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 361/716] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:48.123111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.125649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:48.127264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:48.136580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 356/717] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:48 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:48.152921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb10f8-0775-4993-9be0-dd7d7d42527f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.167930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.168596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.168877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.169151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.169963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:48.170269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.172146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.179994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.191278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1de1e-0af6-480f-be7d-cd11e6d700b1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.191961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 362/718] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:48.201959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.203585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.204656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.205149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.205654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.206595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.210375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.221025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910382b3-708e-421d-8002-d370cba52d78 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.224936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 18:34:48.227236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 357/719] 10.222.0.36 () {56 vars in 1150 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:48.237606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.238864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.239865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.240145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.240469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/b43005d7c7ec4c14bd0708164c20fe53/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.242659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=b43005d7c7ec4c14bd0708164c20fe53, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.249414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bdd14-bdd5-4fb5-b4a9-06aa4ea3454f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.251926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.265273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.266896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.269708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.271240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.272323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:48.273014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.276835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 363/720] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:48 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/b43005d7c7ec4c14bd0708164c20fe53/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:34:48.278084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.294899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 358/721] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:48.301483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.405000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f5f6-e832-4db1-9eb4-8d458175d047 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.413582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.414866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.415143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.415412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.416152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:48.416453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.418077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc153024-5692-4578-ba06-7cdbe96ab150 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.430805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 364/722] 10.222.0.36 () {56 vars in 1145 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:48.431754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.457192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab944f-3925-4fde-8f66-dfcb1ad30d07 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.474585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.476075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.477410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.478094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.480250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.483065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:48.483065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:48.483065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:48.490606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28573ba-12d6-49a0-aeec-18c6b2760564 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.527757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 359/723] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:34:48 2021] POST /identity/v3/endpoints => generated 346 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:48.800517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3d42-9ef9-4322-b39c-4d79c1b3b38f None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.801138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3d42-9ef9-4322-b39c-4d79c1b3b38f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.801138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3d42-9ef9-4322-b39c-4d79c1b3b38f None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.802852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 365/724] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:48.809462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.810622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.811275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.838801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:48.840873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:48.867334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 360/725] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:48 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:48.891619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df3d42-9ef9-4322-b39c-4d79c1b3b38f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.905153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df3d42-9ef9-4322-b39c-4d79c1b3b38f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.910215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.911081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.911357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.911626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.912290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.913884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.925258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 18:34:48.926609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 366/726] 10.222.0.36 () {56 vars in 1153 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:48.933123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.947319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dd41c-83fc-43f0-87b3-69db69a4e38e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:48.953897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:48.954848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:48.955341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:48.955823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:48.956743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:48.957242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:48.959143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19c0b-bbf9-4de3-99b7-dcf419861fb7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:48.970300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 361/727] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:48.971299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:48.994280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373269b-5209-4626-905d-af5161e8201d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:49.002380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:49.003106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.003386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.003659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.004387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:49.004689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:49.006274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cab6d9-2938-46e7-b26e-5e536f2ac826 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:49.016243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 367/728] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:48 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:49.656584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f084-57fe-4da2-8afb-21bbecc0bb2d None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.656964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f084-57fe-4da2-8afb-21bbecc0bb2d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.657347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f084-57fe-4da2-8afb-21bbecc0bb2d None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.660216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 362/729] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:49.669388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.669800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.670200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.703855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:49.705477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:49.719416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 368/730] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:49 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:49.771240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975f084-57fe-4da2-8afb-21bbecc0bb2d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:49.794260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975f084-57fe-4da2-8afb-21bbecc0bb2d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:49.803822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:49.805454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.805841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.806218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.831538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:49.843253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:34:49.845308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 363/731] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:34:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:49.851775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:49.869737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad567d-4c37-4063-939c-e27e40b466b4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:49.881110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:49.882079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.882465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.883423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.884524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:49.885210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:49.887633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:49.904835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 369/732] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:34:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:49.913792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:49.931574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244c969-c518-4c75-b37a-b5d06e68a249 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:49.938055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:49.938888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:49.939169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:49.939441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:49.957055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:49.959019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:49.983442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:49.989754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 364/733] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:49.992808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.017061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552e22-83f6-4dc0-bc68-00e27a0cd557 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.026280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.026970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.027248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.027525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.028266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.028570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.030227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.047886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 370/734] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:50.053817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.067468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2452c3-beae-4965-b29d-c8c06f8e2802 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.078278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.079290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.079579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.079854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.095301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.097327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.115276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e7d75c0e-4589-4f9d-aa7a-eadd2693d127 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:50.121900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 365/735] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:50.123185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.143869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15669-024c-4302-8493-003774f686c9 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.144134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15669-024c-4302-8493-003774f686c9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.144376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f50d8-a71d-4b2e-8a4e-ffb80cdad654 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.144541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15669-024c-4302-8493-003774f686c9 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.146762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 366/736] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:50.154255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.154576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.154871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.155040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.155189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.155334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.155515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.156331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.156746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.158638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.186838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:50.187959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:50.201296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 367/738] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:50 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:50.201532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 371/738] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:50.207131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.219432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9f587-84a7-4e51-8131-42538f202eb1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.225393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.227412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.228048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.228321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.228589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.235767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d88-a163-4cdc-85d8-668b1ccb3a89 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.236819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.238686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.247890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 368/739] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/auth/tokens => generated 1456 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:34:50.248293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.249141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.249418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.249691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] PATH_INFO: `/v3/services/network` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.250406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.252062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.259087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.268082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552877-7385-4119-85a7-24b40551f463 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.270408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 18:34:50.272284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 372/740] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:50.279263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.286689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.287794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.288228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.288638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.303889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf04e6-011c-4f7b-a513-1c7de44fef27 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.308656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.310679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.316246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.317212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.318890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.319339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.320732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] RBAC: Adding query filter params (name=network) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.324237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.326017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.331235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 373/741] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/services?name=network => generated 124 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:50.337609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.340432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:50.341631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 369/742] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:50.347512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5bd7-db9f-413b-8677-5b9eb1636637 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.348720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.353158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.353981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.354407 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.354859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.355716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] RBAC: Adding query filter params (type=network) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.356163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.357886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.364223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8157-bbc5-4e80-905e-5f93fadfd57f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.366436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 374/743] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:50.375939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.382308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.383717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.385374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.385795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.387778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.388234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.390345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.392662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0624-826f-4813-99b4-6efa6c063704 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.405336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.406204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.406686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.407123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.408051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.409212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:50.409212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:34:50.409212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:34:50.411239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.416593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 370/744] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:50.422108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.435446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1329-276d-4c3c-8a4b-21698856afe4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.444813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.448628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 375/745] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:34:50 2021] POST /identity/v3/endpoints => generated 327 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:50.449601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.450026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.450442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.464042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.466071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.494647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:50.501478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 371/746] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:50.502827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.539408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7072d8e-cf3d-45ba-a8e8-5b6ce5dde649 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.550676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.551590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.552015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.552433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.553380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.553858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.556394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77a7e-46e3-44b6-97a7-dc8d408ac83a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.576140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 376/747] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:50.583992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:50.600038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4562c-1e76-420b-851a-5163dcf9ada5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:50.610610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:50.611283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:50.611566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:50.611840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:50.612692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d90d673d13f1441e8fc551b7d0fe7f4a) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:50.613004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:50.614918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa63bb-936c-40a1-b3ec-42f5894e0451 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:50.627794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 372/748] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:50 2021] GET /identity/v3/role_assignments?user.id=d90d673d13f1441e8fc551b7d0fe7f4a&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.021149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3741e-605f-4a94-bdc7-11819af7700a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.022011 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3741e-605f-4a94-bdc7-11819af7700a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.022436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3741e-605f-4a94-bdc7-11819af7700a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.024553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 377/749] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:51.032029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.032511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.032621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.052425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:51.053617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:51.061704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 373/750] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:51 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:51.086672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3741e-605f-4a94-bdc7-11819af7700a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.098741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3741e-605f-4a94-bdc7-11819af7700a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.103627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.104391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.104662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.104928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.115360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:51.122045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:34:51.123454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 378/751] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:51.129796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.139547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b294da-f555-4e70-a174-b4a84811e9fd None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.144180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.144883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.145159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.145426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.146231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.146532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.148131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.156835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 374/752] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.163037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.173766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485828-b31b-4075-bcf7-487654a1acb3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.178346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.179147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.179530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.179840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.192355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.194211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.213362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:51.214635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 379/753] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:51.221788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.231978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10123959-f395-4291-978c-33cf330f8ff3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.236568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.237264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.237543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.237810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.238684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.239033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.240663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.254744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 375/754] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.260885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.270775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d94357-9d5b-4da6-a6d5-b2937eca27da admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.275889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.276710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.276985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.277296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.286058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.288097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.302299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 18:34:51.303823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 380/755] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:51.310076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.324072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64904e-a76b-4586-9f99-921f26b057ed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.328759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.329419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.329698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.329971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.330856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.331165 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.332997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.351045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 376/756] 10.222.0.36 () {56 vars in 1156 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.357709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.367650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29049ac-5a53-4aeb-be9b-e41731b04236 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.372481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.373347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.373872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.374335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.382768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.385197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.395871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 381/757] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:51.403352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.414292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73954-02fd-4715-af7f-bc189a579de9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.419474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.420679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.421191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.421652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.433701 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.435956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.452771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:51.454434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 377/758] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:51.461464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.470854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87a18-5102-4152-a392-105572f7f399 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.475805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.476788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.477268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.477732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.478743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.479305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.481066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834f374-a3f4-4189-8a75-141ae907ebac admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.493720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 382/759] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.500259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.510637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5670ff4-90a7-4d87-a2ea-8df43963461f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.515414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.516443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.516913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.517403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.525120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.527395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.541279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:51.543102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 378/760] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:51.546597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba097f5-8fd8-459c-b052-b12fc90f6c40 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.546597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba097f5-8fd8-459c-b052-b12fc90f6c40 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.546597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba097f5-8fd8-459c-b052-b12fc90f6c40 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.548526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 383/761] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:51.551305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.554651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.555145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.555615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.559925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c39a5c-97ea-4251-ab3b-d1b62c0ffe9f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.565828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.566781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.567258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.567743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.568735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.569688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.572331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.574527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:51.575762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:51.584084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 384/762] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:51 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:51.592738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 379/763] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.598957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.609366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ecc24-d36c-4525-ba45-6d9b3f5ba015 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.613223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.614818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.615705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.615705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.615988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.616830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=b43005d7c7ec4c14bd0708164c20fe53) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.617163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.619059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.625536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 385/764] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/role_assignments?user.id=b43005d7c7ec4c14bd0708164c20fe53&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.626972 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ae70e-1d51-4a36-bfd2-18efe9b68b12 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.635382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.636634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.637192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.637665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.638715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.640645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.653792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 18:34:51.655814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 380/765] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:51.662842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.674311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfe2d-1ee9-4410-b3ce-dd49c2b4ffe9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.679661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.680671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.681194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.681668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.682752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.683307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.685185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707ab20-28bb-4548-93d8-1bf8f751e89d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.691465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 386/766] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:51.698784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:51.709578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155465c8-1508-4ca0-bfe6-5ffbb3e8c880 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:51.716144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:51.717246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:51.717731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:51.718252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:51.719316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:51.719864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:51.721813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66ae4f-9783-442c-9d9e-b32c78888dfd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:51.728449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 381/767] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:51 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:52.012954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d76-c09f-4458-9478-a53841fecf46 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:52.013625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d76-c09f-4458-9478-a53841fecf46 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:52.014115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6616d76-c09f-4458-9478-a53841fecf46 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:52.016357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 387/768] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:52.022821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633ba-48bf-48c5-a0c8-9e8bd685f874 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:52.023906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633ba-48bf-48c5-a0c8-9e8bd685f874 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:52.024414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633ba-48bf-48c5-a0c8-9e8bd685f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:52.042526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6f3633ba-48bf-48c5-a0c8-9e8bd685f874 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:52.044509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6f3633ba-48bf-48c5-a0c8-9e8bd685f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:52.052926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 382/769] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:52 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:52.077973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616d76-c09f-4458-9478-a53841fecf46 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:52.091774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6616d76-c09f-4458-9478-a53841fecf46 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:52.096634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:52.097545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:52.098024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:52.098493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:52.099484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:52.101354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725083ba-9dfe-40e7-bc23-7d9d0086aacf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:52.116294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 388/770] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:34:52 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:53.173361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374619-e684-482c-92f4-9da3ed27d002 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.173903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374619-e684-482c-92f4-9da3ed27d002 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.173903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374619-e684-482c-92f4-9da3ed27d002 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.175957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 383/771] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:53.182177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.182938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.183366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.201648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:53.203080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:53.226840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 389/772] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:53 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:53.246348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374619-e684-482c-92f4-9da3ed27d002 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.260215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374619-e684-482c-92f4-9da3ed27d002 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.264924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.265882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.266311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.266765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.277669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:53.285254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:34:53.290642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 384/773] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:53.294059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.303134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc315d-30fb-4b15-b0e1-1b25ddbbf610 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.307946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.308786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.309214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.309633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.310537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.311043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.312793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.323258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 390/774] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:53.329228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.339315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e72a1c-fb17-4bb2-9d5a-3b81c0df92cb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.344042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.344841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.345119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.345389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.358489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.360398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.377602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:53.383241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 385/775] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:53.386633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.396277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3ea6c-3049-4e1f-ad48-482f98e9bd7d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.400921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.401564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.401845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.402118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.402892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.403199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.404779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.425642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 391/776] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:53.427024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.436980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112087-20a7-41c1-9236-5affc9e84594 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.441600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.442393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.442708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.442985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.451850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.453871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.468061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:53.474538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 386/777] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:53.475974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.486497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc249a9-6b41-4d09-bc60-ba2597325608 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.491122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.491785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.492124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.492393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.493254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.493560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.495428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.514154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 392/778] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:53.520273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.530381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2574359-c38f-4f3c-a74e-34a713fdd47f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.535007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.535641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.535919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.536195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.544401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.546155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.561609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 387/779] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:34:53.563006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.572720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb146b8-85f9-4eec-91f5-b082b75f0384 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.577479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.578310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.578691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.578969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.590068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.591933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.608645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:53.614036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 393/780] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:53.616743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.626394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b657d-d5fe-4188-9c23-da4dd3003b42 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.631065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.631712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.631994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.632329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.633129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.633481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.635360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.653189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 388/781] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:53.654507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.664311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaebe4-4112-4019-9652-b86700e420b7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.668947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.669730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.670056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.670338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.677488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.680263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.693309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:53.698666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 394/782] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:53.701388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.711889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c67a8-a797-4a62-a4f3-84c5417bbf36 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.716734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.717378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.717656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.717977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.718814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.719177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.721093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb087-ed4a-4419-8d92-3d980ded1f47 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.738678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 389/783] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:53.740506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:53.751414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01986-3379-4fb9-b584-6f09c07ca9bc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:53.756230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:53.756865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.757141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.757477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.758356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] RBAC: Adding query filter params (role.id=ba81db2c895748f9a356e2ef18055771, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d90d673d13f1441e8fc551b7d0fe7f4a) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:53.758694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:53.760837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cfc8-d878-46e1-80e1-05d7e00fb9fb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:53.770754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 395/784] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:53 2021] GET /identity/v3/role_assignments?user.id=d90d673d13f1441e8fc551b7d0fe7f4a&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=ba81db2c895748f9a356e2ef18055771 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:53.955847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120dea-df00-426d-8577-c38ca3b5633d None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.956215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120dea-df00-426d-8577-c38ca3b5633d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.956412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120dea-df00-426d-8577-c38ca3b5633d None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.958580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 390/785] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:53.965559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:53.966132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:53.966659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:53.990086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:53.992056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:54.000484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 396/786] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:53 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:54.024671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120dea-df00-426d-8577-c38ca3b5633d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.036859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120dea-df00-426d-8577-c38ca3b5633d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.041254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.042035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.042307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.042601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.043265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.044833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.057259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-4117068e-abaf-41c8-b9e0-b74935b81d57 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 18:34:54.058789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 391/787] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:54.065578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.072981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b096-851a-446e-8ac3-a29c8ca49913 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.073261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b096-851a-446e-8ac3-a29c8ca49913 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.073535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b096-851a-446e-8ac3-a29c8ca49913 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.075523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 392/788] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:34:54.076073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a7f25-9e7b-42d4-bee6-a8e156dec76c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.082467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.082790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.083026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.083147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.084049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.084626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.085202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.086865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:54.087408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.089356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.098921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 397/789] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:54.101313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.103435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:54.104772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:54.112012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2277-72cc-467a-85b9-4a71dc225b5d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.114524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 393/790] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:54 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:54.120498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.120498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.120498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.120498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.120878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:54.120878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.120878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545aabf-f814-457a-ac57-d40f980df305 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.126045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 398/791] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:54.141783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.151849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2aff-5f70-45bb-ab01-b01ecc852bc7 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.157102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.158055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.158480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.158985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.159916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.161140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:54.161140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:54.161140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:54.162381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c28b3-c643-4295-8afe-e1fd3b86366f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.183913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 394/792] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:34:54 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:54.518478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e4621-8a69-4e9c-8ce5-c37e478f83d2 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.519018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e4621-8a69-4e9c-8ce5-c37e478f83d2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.519120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e4621-8a69-4e9c-8ce5-c37e478f83d2 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.521076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 399/793] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:54.527928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.528212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.528487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.546137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:54.547336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:54.564278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 395/794] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:54 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:54.589276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e4621-8a69-4e9c-8ce5-c37e478f83d2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.601444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e4621-8a69-4e9c-8ce5-c37e478f83d2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.605835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.606658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.606939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.607201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.607886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.609467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.621630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 18:34:54.623140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 400/795] 10.222.0.36 () {56 vars in 1153 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:54.629766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.639089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ce9d-0caf-4e84-be33-5755141be3f6 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.643632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.644281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.644558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.644828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.645548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:54.645848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.647471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.653067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 396/796] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:54.659209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.668775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ed31-e1ed-460d-93ed-dcbd4d4def55 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.673383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.674022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.674353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.674671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.675436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:54.675743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.677361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.682612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 401/797] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:54.689112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.699641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948c5b-df77-4f80-bb90-b8450ef79589 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.704488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.705365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.705851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.706324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.707321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] RBAC: Adding query filter params (interface=public, service_id=c04c0fe9f987462aa8ae8f4a593f5697, region_id=RegionOne) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:54.707805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.708999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:34:54.708999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:34:54.708999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:34:54.710174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad7b4f-7f10-4ca6-9a5f-b6dd360022f7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.718439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 397/798] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/endpoints?service_id=c04c0fe9f987462aa8ae8f4a593f5697&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:54.724766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:54.735264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0219f37-1801-4b97-b90f-9afb234c6ea3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:54.740198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:54.741052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:54.741541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:54.742069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:54.742964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:54.744758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8ea7f-1d0d-480a-8fe2-1d655d7b8621 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:54.751066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 402/799] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:34:54 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:34:56.107356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243cda-c754-427c-ae14-8b6c86fd2221 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.108363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243cda-c754-427c-ae14-8b6c86fd2221 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.108873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243cda-c754-427c-ae14-8b6c86fd2221 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.111155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 398/800] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:56.117483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.117908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.118093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.136305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:56.137503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:56.150651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 403/801] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:56 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:56.170271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243cda-c754-427c-ae14-8b6c86fd2221 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.182620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243cda-c754-427c-ae14-8b6c86fd2221 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.187002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.187786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.188067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.188342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.199622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:56.206925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:34:56.211981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 399/802] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:56.215121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.224154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0737-bebc-4eee-8113-67b797486cc8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.229273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.229924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.230205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.230479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.231272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.231578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.233156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.245153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 404/803] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.248000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.258273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bd8c-ff96-402c-b51e-f4c130ebe1bb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.263184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.263954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.264232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.264502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.274874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.276703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.295556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:56.302354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 400/804] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:56.303876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.314089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442047a-ec92-44f1-856e-99e79474891c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.318780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.319453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.319732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.320540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.321287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.321591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.323206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.340745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 405/805] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.342099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.352374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62618698-5e82-4e3b-b322-c9668715fbb5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.356968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.357816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.358100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.358373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.365729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.367834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.382059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-406e44e4-e05d-4c62-8397-aaa2f882ec7a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:56.389679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 401/806] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:56.391200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.401793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c30-1b01-4557-b868-5f5482c4df63 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.406681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.407374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.407655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.407928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.408802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.409111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.411064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.434910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 406/807] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.436662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-415b-4af2-bfe3-d6118ca3f97a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.436960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-415b-4af2-bfe3-d6118ca3f97a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.437230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90db9-415b-4af2-bfe3-d6118ca3f97a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.439540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 402/808] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:56.439660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.449091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.449380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.449585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34107d-d1e1-4036-a22d-99d4e99d90dc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.449712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.454152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.455008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.455288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.455560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.466370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.468237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.470210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:56.471898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:56.485519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:56.486648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 403/809] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:56 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:56.486979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 407/810] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:56.493154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.502653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19ebf3-d981-4aef-b5ef-da279820d384 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.508112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.508766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.508875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.509048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.509316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.510517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.510897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.512483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.524314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee935c-b804-4afd-93d9-97619f23723c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.528339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 404/811] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:56.531208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.532159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.532642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.533357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.534401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.535592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.537206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b7117-57d9-4859-9723-34f82d0778b0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.547907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123017c-df70-4986-9820-134cd5d883a8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.551827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 408/812] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:34:56 2021] POST /identity/v3/services => generated 241 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:34:56.553224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8bd9-e6e2-48c3-a125-66652995b0e7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.553515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8bd9-e6e2-48c3-a125-66652995b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.553794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8bd9-e6e2-48c3-a125-66652995b0e7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.558583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 409/813] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:56.564462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.565090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.565669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.574773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.575302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.575587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.575858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.583771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.586326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.589262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:56.590909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:56.600081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 410/814] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:56 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:56.605311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:56.607342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 405/815] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:56.614716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.624600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.625300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccb429-5d4d-464b-9d7c-0e076fdd7222 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.630257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.631290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.631744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.632157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.633274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.633942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.635184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1bf3-a4f3-42a6-8147-22eff9b28b40 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.636935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.640603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.641415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.641748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.642024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.642748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.644519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.659047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 18:34:56.666588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 411/816] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.666797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 406/817] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:56.667146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.668457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.677503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99ffc-e603-4187-a129-1cae0beeb58e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.681131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69a96d-f69b-4acd-b84a-0d0f5dcefa45 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.682905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.683735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.684039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.684336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.685067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.685369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.687043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.687195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.688503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.688964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.689757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d90d673d13f1441e8fc551b7d0fe7f4a/roles/ba81db2c895748f9a356e2ef18055771` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.692627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=d90d673d13f1441e8fc551b7d0fe7f4a, role_id=ba81db2c895748f9a356e2ef18055771)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.692901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 407/818] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.695914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.699553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.711999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375e6f-60a2-4859-ac1f-2be4516d5033 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.714723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 412/819] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:34:56 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/d90d673d13f1441e8fc551b7d0fe7f4a/roles/ba81db2c895748f9a356e2ef18055771 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:34:56.784256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.784854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.785135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.785451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.786195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.786498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.788258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.794218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 408/820] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:56.800867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.812083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564cd1-3a36-4297-b0d5-2ee36bba9f96 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.817055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.817967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.818347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.818753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.819806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] RBAC: Adding query filter params (interface=public, service_id=c5d2c640f87245ce8269fdc1d4e3e9e1, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:56.820282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.822060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674393df-611b-4f87-a8ca-77abf16c4b07 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.828553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 413/821] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/endpoints?service_id=c5d2c640f87245ce8269fdc1d4e3e9e1&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:56.834833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:56.846034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2431-e564-4359-8e06-a90b13dd11a2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:56.851475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:56.852305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:56.852741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:56.853125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:56.854000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:56.855981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb75733-13ce-4461-973b-efea2966dfac admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:56.863557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 409/822] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:34:56 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:34:57.153460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a2647-226c-4384-9f89-de4ed7879d9a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.154165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a2647-226c-4384-9f89-de4ed7879d9a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.154165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a2647-226c-4384-9f89-de4ed7879d9a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.156021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 414/823] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:57.162140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.162671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.162830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.180540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:57.181709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:57.189904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 410/824] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:57 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:57.213852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a2647-226c-4384-9f89-de4ed7879d9a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:57.225901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a2647-226c-4384-9f89-de4ed7879d9a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:57.230799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:57.231579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.231849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.232114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.232764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:57.234319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:57.246000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 18:34:57.247400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 415/825] 10.222.0.36 () {56 vars in 1153 bytes} [Mon Oct 18 18:34:57 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:57.253846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:57.263086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52911240-9425-458e-a6e1-d78a86413a53 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:57.267600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:57.268243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.268516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.268784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.269498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:57.269795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:57.271437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:57.276872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 411/826] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:57 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:57.282960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:57.292895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e212-efb7-4833-8252-5fef5b7a2aff admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:57.297311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:57.297939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.298212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.298477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.299239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:57.299534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:57.301086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1d2b-e0c6-4cc8-9628-20f3e5006375 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:57.306492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 416/827] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:57 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:57.312421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:57.322098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085832-fcf7-444c-9d0a-d96ae609a591 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:57.326679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:57.327308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:57.327586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:57.327857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:57.328605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:57.330163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa15ad-fcb8-4090-81fe-46837ac94c2f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:57.351779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 412/828] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:34:57 2021] POST /identity/v3/endpoints => generated 347 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:34:58.954299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1e11-19b0-453a-ad11-4f97971e3f68 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:58.955080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1e11-19b0-453a-ad11-4f97971e3f68 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:58.955080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1e11-19b0-453a-ad11-4f97971e3f68 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:58.957061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 417/829] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:58.963787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c4f63-5383-4865-a764-0106ab35e89a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:58.964290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c4f63-5383-4865-a764-0106ab35e89a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:58.964451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c4f63-5383-4865-a764-0106ab35e89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:58.982238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-da4c4f63-5383-4865-a764-0106ab35e89a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:58.983441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-da4c4f63-5383-4865-a764-0106ab35e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:59.006652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 413/830] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:58 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:59.025923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e1e11-19b0-453a-ad11-4f97971e3f68 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.038044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e1e11-19b0-453a-ad11-4f97971e3f68 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.042456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.043265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.043537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.043803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.044466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.046032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.058043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 18:34:59.061054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d818-9cd4-4553-81cf-2a347e3a4e64 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.061336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d818-9cd4-4553-81cf-2a347e3a4e64 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.061652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d818-9cd4-4553-81cf-2a347e3a4e64 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.063553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 414/831] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:59.063929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 418/832] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.069959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.070471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.070894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.071262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.080013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64f04-f8fb-4fa8-8602-4004279bf110 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.084664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.085329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.086135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.086409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.087181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.087484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.089113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.091640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:59.092922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:59.094379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 419/833] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:59.100932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.101916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 415/834] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:59 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:34:59.111122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599f3f-a441-43a0-b0dd-e64ebf269a83 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.115721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.116373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.116651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.117462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.118180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.118483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.120097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.125505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 420/835] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.127925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.131708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.138782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020684e8-53a3-4020-9e22-df0519fece6f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.141328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7b0-cdbd-4f6d-9a55-a09ec6a1f7b8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.143691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.144644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.144987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.145415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.145789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.146431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.146743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.147019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.147820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] RBAC: Adding query filter params (interface=public, service_id=cfc24ef37abd478494aed62f69ac32c0, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.148646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.150222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.156079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 421/836] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/endpoints?service_id=cfc24ef37abd478494aed62f69ac32c0&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.159485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:34:59.162052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.167238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:34:59.171252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a3bae-c7fc-4ab2-9b6a-dcfe356b6853 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.173045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 416/837] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.175509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.175708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.176347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.176625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.176900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.177585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.179251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.185429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1845a-50ae-4ed8-8031-f53c8fb57c19 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.186468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 422/838] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:34:59.190157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.190869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.191148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.191416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.192187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.192487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.194126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac592-4585-4daf-850c-62b6f6ec437f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.210112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 417/839] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.211475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.226755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd5a0-d4ff-4eca-9090-005f23a51370 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.231601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.232406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.232688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.232958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.245141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.247454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.252857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeba04-4a0c-405c-9106-d4c939bb7dfb None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.253497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeba04-4a0c-405c-9106-d4c939bb7dfb None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.254061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeba04-4a0c-405c-9106-d4c939bb7dfb None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.258885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 418/840] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:59.266609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.267383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.268156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.271150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:59.274597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 423/841] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.280129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.291755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa0db-b3e1-4ad4-8449-3c3977ac8b56 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.296722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.297744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.298031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:59.298442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.298945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.299311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:59.300225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.300765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.303112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.314582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 419/842] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:59 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:59.321572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 424/843] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:59.331769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.337199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.343357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83e1d-eb0d-437e-af33-96c9da4df667 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.347430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecb2f3-c660-4a27-aa24-c01308110bfd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.348763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.350091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.350742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.351317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.352738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.353621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.353976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.354316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.355110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.356802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.361807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.364228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.368708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 18:34:59.375987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 425/844] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.377042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.381410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 18:34:59.388066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 420/845] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.388231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dc2de-bfb3-4dd2-99ce-ca14c5bf31b6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.391551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.393300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.394069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.394418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.394795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.395599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.395992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.397660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.403838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 426/846] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.405292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ba779-d57a-443e-babe-e7ab65e83fa6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.410225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.411149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.411269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.411817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.412305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.413420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.413921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.415799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.421893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28a9ff-92ca-4ba0-80bf-e5658bad194e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.427258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.427899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.428173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.428435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.429200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.429503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.431097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.436990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 421/848] 10.222.0.36 () {56 vars in 1170 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.438652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 427/848] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.443270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.443474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.453759 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd297b-bce8-4b0f-9385-a7733d1b3f47 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.453899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4af17-83c3-49f1-8b6a-ca1b72f220de admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.458358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.458911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.459128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.459369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.459537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.459640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.459818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.460057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.460459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.462575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.469428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.471249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.485616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 428/849] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:34:59.486859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.489255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 422/850] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:34:59 2021] POST /identity/v3/endpoints => generated 346 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:34:59.500438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637e38-88ad-4a09-9108-b2eae61175e6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.517094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.517898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.518172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.518494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.531477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.533467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.554049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:34:59.555955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 429/851] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:34:59.563056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.574327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3bc7-bec9-4474-8466-6077b50edd9e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.579485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.580618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.581079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.581544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.582958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.583453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.585381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.604743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 423/852] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:59.606133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.617384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eed8c-f9fd-42b3-aba5-fe82a1085823 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.622467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.623328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.623607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.623861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.632360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.635984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.655147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-a5ef40bd-b75a-4dd6-8e15-84837ed53e45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:34:59.660659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 430/853] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.663887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.674749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf1b55-b3cb-4298-ab97-e66cc055dad0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.681486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.682625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.683109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.683560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.684747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.685123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.690738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.705038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 424/854] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:59.706881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8c35-e509-4d1f-99c5-ad8debfcbd21 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.707166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8c35-e509-4d1f-99c5-ad8debfcbd21 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.707441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8c35-e509-4d1f-99c5-ad8debfcbd21 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.709622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 431/855] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:34:59.709806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.716823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.717080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.717300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.724282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b6e6c-1abd-4d66-a8e7-5bdd73b80ec2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.728902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.729545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.729827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.730096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.731016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] RBAC: Adding query filter params (role.id=ba81db2c895748f9a356e2ef18055771, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=d90d673d13f1441e8fc551b7d0fe7f4a) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.731321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.733152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.739237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 425/856] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/role_assignments?user.id=d90d673d13f1441e8fc551b7d0fe7f4a&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=ba81db2c895748f9a356e2ef18055771 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:34:59.739487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:34:59.740810 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:34:59.749886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 432/857] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:34:59 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:34:59.774640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.784727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66969e-c858-4538-9379-e94a508ce653 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.789637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.790426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.790741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.790998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.791665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.793255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.805485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 18:34:59.806788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 426/858] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:34:59.814028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.823509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba3185-21c3-48a2-a77d-9e25f571ad86 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.828332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.829021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.829308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.829566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.830310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] RBAC: Adding query filter params (name=compute) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.830643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.832298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a432b0-0a20-45d1-8158-0ce838f88eab admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.838597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 433/859] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:34:59.845049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:34:59.855267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e311693-fb65-493c-a673-b97b13146d62 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:34:59.860002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:34:59.860672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:34:59.861007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:34:59.861277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:34:59.862055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:34:59.862361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:34:59.864068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b597a35-f2d4-4546-8e68-185c244f5b5e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:34:59.870001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 427/860] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:34:59 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:01.656478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ee71-e684-4a54-8e06-e7a5445c0043 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.656995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ee71-e684-4a54-8e06-e7a5445c0043 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.657070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ee71-e684-4a54-8e06-e7a5445c0043 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.659055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 434/861] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:01.666063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.666478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.666692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.688316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:01.689521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:01.697806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 428/862] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:01 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:01.721708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09ee71-e684-4a54-8e06-e7a5445c0043 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:01.734614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09ee71-e684-4a54-8e06-e7a5445c0043 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:01.739047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:01.739835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.740115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.740389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.741056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:01.743236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:01.754592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 18:35:01.756049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 435/863] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:35:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:01.763896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:01.773585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e6d3-2a8a-4501-880e-6cd21c7839f8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:01.778394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:01.779117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.779380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.779658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.780395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:01.780704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:01.782347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:01.788117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 429/864] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:01.794462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:01.805229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b708a8-1c80-419a-8421-1c59bd1ddb2e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:01.810090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:01.810797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.811076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.811348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.812080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:01.812564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:01.814190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e243-e636-4d7e-8295-b774ae064871 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:01.820650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 436/865] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:01.827125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:01.836914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688019dd-6ea8-4b1f-a672-9c7ce8553976 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:01.841504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:01.842153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.842430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.842738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.843504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:01.845088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16816c-b1b0-4419-a736-d757f1a1aa40 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:01.871346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 430/866] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:35:01 2021] POST /identity/v3/endpoints => generated 349 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:01.947009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c646-3373-425a-8c1f-59eb6ed549d6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.947217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c646-3373-425a-8c1f-59eb6ed549d6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.947604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c646-3373-425a-8c1f-59eb6ed549d6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.950597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 437/867] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:01.959349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:01.959349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:01.959349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:01.980700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:01.982191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:02.006715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 431/868] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:01 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:02.027263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c646-3373-425a-8c1f-59eb6ed549d6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.040954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c646-3373-425a-8c1f-59eb6ed549d6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.045873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.046906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.047388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.047846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.048839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.050882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.052444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.common [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 18:35:02.073142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.sql.core [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 18:35:02.073142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 18:35:02.073142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [parameters: {'id': '5eeca65ef79a4838bebcbe178f610760', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 18:35:02.073142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=109153) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 18:35:02.090074 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5eeca65ef79a4838bebcbe178f610760.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5eeca65ef79a4838bebcbe178f610760. Oct 18 18:35:02.091947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 438/869] 10.222.0.36 () {60 vars in 1161 bytes} [Mon Oct 18 18:35:02 2021] POST /identity/v3/projects => generated 262 bytes in 65 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:02.098971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.108376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab4b2-be8d-4af3-bd30-7f61bf04aa15 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.113187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.114153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.114695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.115135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.123067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.125291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.139938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-772a09bd-9796-45b9-acd9-d171f4c77ca1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:35:02.143850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 432/870] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:02.148667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.159412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f150a2-9d8d-4676-bcb9-4be2f3924f0c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.164799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.165477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.165755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.166025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.166861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:02.167164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.169463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c0c7-170c-498e-a61f-59817ac17134 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.194210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 439/871] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:35:02 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:02.314395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5530-7c77-40d2-bd31-c50b16dedc6f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.314784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5530-7c77-40d2-bd31-c50b16dedc6f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.314991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5530-7c77-40d2-bd31-c50b16dedc6f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.317116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 433/872] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:02.324472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f88d7-7784-41f8-9f27-03c3e5f4f0c7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.324811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f88d7-7784-41f8-9f27-03c3e5f4f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.325029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f88d7-7784-41f8-9f27-03c3e5f4f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.344433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-114f88d7-7784-41f8-9f27-03c3e5f4f0c7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:02.346068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-114f88d7-7784-41f8-9f27-03c3e5f4f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:02.354026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d970c-8910-41f0-a8a1-8882d831c246 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.354357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d970c-8910-41f0-a8a1-8882d831c246 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.354625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d970c-8910-41f0-a8a1-8882d831c246 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.355193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 440/873] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:02 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:02.356561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 434/874] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:35:02.362877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.363173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.363437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.380182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d970c-8910-41f0-a8a1-8882d831c246 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.381958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:02.383864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:02.392427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 441/875] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:02 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:02.396355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d970c-8910-41f0-a8a1-8882d831c246 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.401276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.402031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.402434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.402807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.403678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.405395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.416722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.422791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 435/876] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:35:02 2021] POST /identity/v3/services => generated 242 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:35:02.425720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911198c-99b5-47a2-804d-6359d7cddcbd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.442066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.442898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.443178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.443451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] PATH_INFO: `/v3/services/image` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.444131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.446283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.458402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 18:35:02.460035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 442/877] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Oct 18 18:35:02 2021] GET /identity/v3/services/image => generated 86 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:02.467060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.479620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4447-c785-43c5-b038-f5652a758817 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.485101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.485778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.486063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.486339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.488168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:02.488168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.489343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f51ca-6a2c-428d-bd51-d9b4ae74b9b5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.495584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 436/878] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:02 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:02.502219 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:02.513562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151836a0-4c36-4b77-8908-e5a69718abde admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:02.518743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:02.519427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:02.519757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:02.520041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:02.520783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] RBAC: Adding query filter params (type=image) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:02.521194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:02.522879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a976e9-9421-4852-9589-4ce69912017c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:02.528580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 443/879] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:02 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.245718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca024e-5a3c-498c-8c8d-7f4ee443df73 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.246208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca024e-5a3c-498c-8c8d-7f4ee443df73 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.246208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca024e-5a3c-498c-8c8d-7f4ee443df73 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.248226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 437/880] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:04.254357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.254811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.255030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.277357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:04.278901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:04.287185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 444/881] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:04.311363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca024e-5a3c-498c-8c8d-7f4ee443df73 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.323708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca024e-5a3c-498c-8c8d-7f4ee443df73 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.332734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.333556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.333836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.334110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.334830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.337383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.351841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 18:35:04.353358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 438/882] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:04.360078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.369098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2a46-dff4-4fae-9d56-0df24a3ca836 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.373681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.374332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.374638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.374914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.375637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:04.375942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.377529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.382767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 445/883] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.389494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.399843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9814b6-3bbb-4f79-b90c-6d1396528f22 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.404445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.405093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.405371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.405643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.406356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:04.406689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.408271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.414303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 439/884] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.420932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.430611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4df570-d01b-48b3-8ea9-8b90316167e5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.435207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.435846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.436125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.436395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.437191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] RBAC: Adding query filter params (interface=admin, service_id=cfc24ef37abd478494aed62f69ac32c0, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:04.437499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.439098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea663491-15d9-4a89-8137-18f25b25e37e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.444486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 446/885] 10.222.0.36 () {56 vars in 1270 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/endpoints?service_id=cfc24ef37abd478494aed62f69ac32c0&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.451234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.461475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9fbae-2144-4932-bfaa-0773dd724823 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.466124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.466820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.467100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.467461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.468061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.469741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f30bf1-6237-4ad5-ac48-538e61211aef admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.477546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 440/886] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:35:04.629527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34598-cff8-4ff8-814f-f473129b4169 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.630211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34598-cff8-4ff8-814f-f473129b4169 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.630751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34598-cff8-4ff8-814f-f473129b4169 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.633728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 447/887] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:04.640842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.641164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.641384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.660610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:04.661870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:04.671271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 441/888] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:04.698372 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34598-cff8-4ff8-814f-f473129b4169 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.713030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34598-cff8-4ff8-814f-f473129b4169 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.717800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.718893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.719316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.719755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.720638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.722703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.739416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.sql.core [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 18:35:04.739416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 18:35:04.739416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [parameters: {'user_id': 'e11838ea0f73435e90dab657e0704c08', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 18:35:04.739416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=109153) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 18:35:04.746569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 18:35:04.750240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 448/889] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/users => generated 160 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:04.755068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.764406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b122d50-641d-450f-8fe8-8abaf01951a9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.769045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.769820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.770091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.770353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.778476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.780570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.794419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ed0ded14-3ba8-4b6f-99c4-729d207b7687 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 18:35:04.799258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 442/890] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/users/cinder => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:04.802756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.812899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db675ffd-1450-47e5-a627-c4d3eeb201d5 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.813335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db675ffd-1450-47e5-a627-c4d3eeb201d5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.813442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db675ffd-1450-47e5-a627-c4d3eeb201d5 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.814511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda3fa-42b5-448d-8259-8804340e1104 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.815528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 443/891] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:35:04.819457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.820519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.820798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.821064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.821383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73988a-7401-440d-a39a-d2bb8710dcb9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.821670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73988a-7401-440d-a39a-d2bb8710dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.821879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:04.821978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73988a-7401-440d-a39a-d2bb8710dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.822180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.824345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.840501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2f73988a-7401-440d-a39a-d2bb8710dcb9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:04.841706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2f73988a-7401-440d-a39a-d2bb8710dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:04.850629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 444/892] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:04.861539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f838c-4981-4cea-a122-a0a9a49f6ff6 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.861825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f838c-4981-4cea-a122-a0a9a49f6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.862105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f838c-4981-4cea-a122-a0a9a49f6ff6 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.864135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 445/894] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:35:04.868999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 449/894] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.870695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.870986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.871263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.876772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.889559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa163b-5d7c-4879-a71d-5b8446a7f840 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.890947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:04.892247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:04.894249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.895155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.895450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.895783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.896480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.898935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.910675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 446/895] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:04.919004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 18:35:04.921735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 450/896] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services/compute => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:35:04.928813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.932503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.944721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189a12-5625-4401-a392-a44c69f61a2d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.944958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d492d3-7e70-4057-8a87-133caf795ef9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:04.950872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.951784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:04.952674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.953574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:04.954052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.954508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:04.954984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.955259 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:04.956123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:04.956280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.956751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:04.958099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.958792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:04.966670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 447/897] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:04.973605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:04.990710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 451/898] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:35:04 2021] POST /identity/v3/services => generated 242 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:05.000446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fae8-95a1-4534-bf8e-40e76e87267c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:05.018694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:05.019735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:05.020222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:05.020762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:05.021763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:05.022282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:05.024899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:05.031674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 448/899] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:35:04 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:05.038203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:05.050231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e00079-f91d-4bda-b54d-103c6741d5bb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:05.056708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:05.057492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:05.057870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:05.058154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:05.059097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] RBAC: Adding query filter params (interface=public, service_id=9493415917bf43c3a14ce8e9fc2bbb7e, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:05.059415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:05.061298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa0d61-5edf-4d8f-afda-f98bfaf9ec56 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:05.068188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 452/900] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:35:05 2021] GET /identity/v3/endpoints?service_id=9493415917bf43c3a14ce8e9fc2bbb7e&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:05.074471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:05.088257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302921c-c268-4f35-8498-a87aa6e79772 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:05.093081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:05.093761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:05.094042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:05.094316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:05.095059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:05.096742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7974d2-3c6e-4a9d-a717-8047e16c5842 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:05.104888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 449/901] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:35:05 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:35:06.837957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0f13-76b9-45c5-80ed-aaab0eebb596 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:06.838481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0f13-76b9-45c5-80ed-aaab0eebb596 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:06.838481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e0f13-76b9-45c5-80ed-aaab0eebb596 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:06.840322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 453/902] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:06.846222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:06.846630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:06.846814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:06.864105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:06.865280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:06.872966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 450/903] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:06 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:06.898230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e0f13-76b9-45c5-80ed-aaab0eebb596 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:06.910278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e0f13-76b9-45c5-80ed-aaab0eebb596 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:06.915266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:06.916048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:06.916325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:06.916591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:06.917250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:06.918843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:06.929759 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 18:35:06.930954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 454/904] 10.222.0.36 () {56 vars in 1147 bytes} [Mon Oct 18 18:35:06 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:06.937539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:06.947151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681586-bdf9-45c5-bd9c-9a893b563627 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:06.951643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:06.952352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:06.952694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:06.953031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:06.953809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:06.954173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:06.955860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:06.962649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 451/905] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:06 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:06.968264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:06.984335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eaa0e-4087-44cc-b0e9-dac45a8ec518 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:06.991134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:06.992305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:06.992305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:06.992450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:06.993069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:06.993371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:06.998305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15087e4-bf86-44ad-9037-23983e4e0edb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.004929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 455/906] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Oct 18 18:35:06 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:07.010349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.019805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1f-5ba4-4dab-b2d1-a7efc0f4596a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.024814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.025446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.025722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.025990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.026767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.028338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f893e-bf28-4cc3-9fa3-b5abd7941501 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.050824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 452/907] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:35:07 2021] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:07.312585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e1da-8e9b-4c78-a045-6bca4f4b7392 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.312972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e1da-8e9b-4c78-a045-6bca4f4b7392 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.313166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e1da-8e9b-4c78-a045-6bca4f4b7392 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.315151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 456/908] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:07.320995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b4e6-bfa4-4d20-a351-0340a61395ac None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.321281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b4e6-bfa4-4d20-a351-0340a61395ac None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.321560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b4e6-bfa4-4d20-a351-0340a61395ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.340131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c486b4e6-bfa4-4d20-a351-0340a61395ac None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:07.341316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c486b4e6-bfa4-4d20-a351-0340a61395ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:07.358385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 453/909] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:07 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:07.381672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62e1da-8e9b-4c78-a045-6bca4f4b7392 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.397103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62e1da-8e9b-4c78-a045-6bca4f4b7392 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.401929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.402806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.403089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.403359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.404024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.405612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.412634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6052-4360-46db-8a66-e1eede2acd33 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.412918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6052-4360-46db-8a66-e1eede2acd33 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.413187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6052-4360-46db-8a66-e1eede2acd33 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.415189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 454/910] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:35:07.416345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 18:35:07.422845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 457/911] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:07.423952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.424138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.424236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.424503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.433646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca42a9b-5915-418b-8d37-ed72d838a6b1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.438069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.438730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.439017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.439271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.439975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] RBAC: Adding query filter params (name=image) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:07.440270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.441827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.442690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:07.443889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:07.447491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 458/912] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:07.452241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 455/913] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:07 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:07.453623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.463401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbdb7f-a9ec-4dac-9df8-3564e6211d81 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.468054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.468674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.468995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.469526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.470267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] RBAC: Adding query filter params (type=image) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:07.470610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.472121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.477074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.477230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 459/914] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:07.483743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.487635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb19115-cadf-4ee2-ade2-f4ac959e95e1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.493193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019165c0-b221-437a-849f-bc41347bef2b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.493654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.494432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.494731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.494997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.495660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.497234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.498859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.499645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.500087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.500505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.501448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] RBAC: Adding query filter params (interface=public, service_id=304a03716596448ba1ce018109bc9ad0, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:07.501901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.503614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.508574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 18:35:07.509411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 460/915] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/endpoints?service_id=304a03716596448ba1ce018109bc9ad0&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:07.511156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 456/916] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:07.517106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.518218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.528003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd5cc-5b83-4bf4-8d7f-0f8fb747796e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.528122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3f880-4880-4c29-ba3d-6322dfa4b9ad admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.532338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.532529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.532950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.533141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.533235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.533422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.533514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.533696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.534160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:07.534369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.534474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.535948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.536043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.542697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 457/917] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:07.543156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 461/918] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:35:07.548160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.558796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aab2-96b6-41dc-8cf0-c4cd4afe01e7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.563652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.564240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.564518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.564787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.565520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:07.565820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.567565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76110a-7f56-49b5-87ed-abb827522199 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.578887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 462/919] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Oct 18 18:35:07 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:07.579794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:07.589695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ea641-f271-4f14-bce4-fd8bcff03ecd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:07.594281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:07.594992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:07.595267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:07.595532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:07.596304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:07.597916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ba45e-408f-4232-a584-8066c4dbdb1f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:07.618945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 458/920] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:35:07 2021] POST /identity/v3/endpoints => generated 334 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:35:09.322984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb61c-884a-4190-80f2-5d86897782b2 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.323506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb61c-884a-4190-80f2-5d86897782b2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.323506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb61c-884a-4190-80f2-5d86897782b2 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.325439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 463/921] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:09.331294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.331689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.331886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.349783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:09.351048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:09.368885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 459/922] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:09 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:09.393359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb61c-884a-4190-80f2-5d86897782b2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:09.406012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb61c-884a-4190-80f2-5d86897782b2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:09.410337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:09.411166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.411442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.411706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.412915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:09.414662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c503d5-8092-4575-ac26-f79b06ab6555 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:09.416482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 464/923] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:09.422822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:09.432798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ead4-6d32-49ec-8bc8-827eebcb9935 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:09.437525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:09.438185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.438467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.438774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.439528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:09.441426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f659b6-12f2-450c-80e3-75e77279ddde admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:09.468619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 460/924] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:35:09 2021] POST /identity/v3/projects => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:09.850450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0823-2712-4dee-b9af-57733354bc75 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.851332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0823-2712-4dee-b9af-57733354bc75 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.851555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0823-2712-4dee-b9af-57733354bc75 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.853312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 465/925] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:09.859789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6bbd-cdbd-4d42-9eda-5232d423a319 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.860124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6bbd-cdbd-4d42-9eda-5232d423a319 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.860340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6bbd-cdbd-4d42-9eda-5232d423a319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.879145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a9ee6bbd-cdbd-4d42-9eda-5232d423a319 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:09.880372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a9ee6bbd-cdbd-4d42-9eda-5232d423a319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:09.938651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 461/926] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:09 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:09.961943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0823-2712-4dee-b9af-57733354bc75 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:09.973757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0823-2712-4dee-b9af-57733354bc75 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:09.982935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:09.983707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:09.983984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:09.984254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] PATH_INFO: `/v3/services/image` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:09.984919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:09.986488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.001834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 18:35:10.008366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c64d3-f278-46b3-89fa-794334d130a5 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.008601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 466/927] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Oct 18 18:35:09 2021] GET /identity/v3/services/image => generated 86 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:10.008910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c64d3-f278-46b3-89fa-794334d130a5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.009193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c64d3-f278-46b3-89fa-794334d130a5 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.009415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.011350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 462/928] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:35:10.017018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.017295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.017575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.019787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48256-4482-4fc0-b87f-f4ff54aaf27e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.024936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.025561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.025846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.026121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.026859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.027164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.028726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.033616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 467/929] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:10.035442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:10.036638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:10.040259 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.047431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 463/930] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:10 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:10.050935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3d57-a15a-4c0b-8783-6ab676bfd5d3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.055602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.056229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.056506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.056778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.057482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] RBAC: Adding query filter params (type=image) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.057779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.059354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.068611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 468/931] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:10.070411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.071403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.080452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743951-8086-4726-84db-0cbc2d1c3a13 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.081981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe82d6-1cd8-4de7-906f-503946cbd9d5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.084899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.086193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.086474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.086796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.087273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.087877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.088162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.088524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.089373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.090781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.103430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:10.110865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 464/932] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:35:10 2021] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:35:10.118765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:35:10.118765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 469/933] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:35:10.119893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.130035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27910e-3e94-43cf-a3f9-849c5d2130eb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.146379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.147094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.147376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.148195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.148973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.149280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.151209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.166261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 470/934] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:10.167539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.178096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8fcc7-d22d-4957-a29d-f248f7fe4aef admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.183543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.184363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.184644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.184917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.196318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.198209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.216558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:10.217991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 465/935] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:35:10.224387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.234908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c90a-fe08-4717-be83-68465f92e58b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.239601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.240277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.240562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.240836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.241628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.241933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.243598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.256352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 471/936] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:10.263246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.274311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59b8e-7506-40c6-a149-97c62d6306b5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.279256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.280161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.280512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.280857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.289677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.291747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.306483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:35:10.307931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 466/937] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:10.314242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.324159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353aff-9aa7-4dc2-a676-6cb622e13971 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.329635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.330430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.330821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.331089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.331940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.332247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.334088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.354234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 472/938] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:10.360549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.370607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3555-6443-46b8-8da1-f99235f3804b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.375382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.376022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.376295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.376570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.385002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.386777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.400809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 467/939] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:10.407157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.416713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbba83-f7c8-4208-b299-0b6f155442a9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.421120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.421886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.422160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.422425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.432341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.434140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.451193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:10.452450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 473/940] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:10.458479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.468155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e058f-1af0-4a87-bbdf-b307a26aacb3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.472915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.473555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.473827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.474089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.474847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.475142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.476825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.488318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 468/941] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:10.494291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.504025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a20ed7-3c0d-4f5e-aa50-d95863183424 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.509141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.510241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.510621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.510977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.517916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.519970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.533213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:35:10.534507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 474/942] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:35:10.541040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.550820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbd861-2125-401d-b775-1099dc6b802b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.555410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.556146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.556478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.556835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.557690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.558059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.559968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc429f-56fe-4603-aa59-aeddbfee8c57 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.572732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 469/943] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:10.579162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:10.590066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb2aa-0729-45f5-8d0b-3842e8d5dc70 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:10.594673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:10.595390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:10.595740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:10.596093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:10.596991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] RBAC: Adding query filter params (role.id=ba81db2c895748f9a356e2ef18055771, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:10.597379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:10.599237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7965-6870-4579-bf06-8361af2c4fb9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:10.604743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 475/944] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:10 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=ba81db2c895748f9a356e2ef18055771 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:11.811606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba0b1-7e44-4213-a4da-5ed92de02db2 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:11.812115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba0b1-7e44-4213-a4da-5ed92de02db2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:11.812189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba0b1-7e44-4213-a4da-5ed92de02db2 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:11.814222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 470/945] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:11.820210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:11.820658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:11.820835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:11.838663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:11.840161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:11.847883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 476/946] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:11.874296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba0b1-7e44-4213-a4da-5ed92de02db2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:11.886650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba0b1-7e44-4213-a4da-5ed92de02db2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:11.890927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:11.891698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:11.891970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:11.892237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:11.893393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:11.895088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12659ba1-9cc2-4c10-a601-97915e10a18c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:11.896789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 471/947] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:11.903352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:11.912093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2b14a-af7b-49ef-9801-12bf51b79f55 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:11.916618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:11.917265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:11.917540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:11.917809 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:11.918535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:11.920454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a7925-bf27-415d-91d7-dca4b0f2f517 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:11.940679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 477/948] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:35:11 2021] POST /identity/v3/users => generated 285 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:12.423587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ee-9b41-414f-bcf1-0f86702d6bbe None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.424011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ee-9b41-414f-bcf1-0f86702d6bbe None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.424194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ee-9b41-414f-bcf1-0f86702d6bbe None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.425960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 472/949] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:12.432337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.432625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.432899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.450661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:12.451847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:12.459680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 478/950] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:12.484164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a0ee-9b41-414f-bcf1-0f86702d6bbe None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:12.496846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a0ee-9b41-414f-bcf1-0f86702d6bbe None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:12.501354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:12.501988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.502265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.502536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.511459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:12.513220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e0872-0832-49c2-950a-3b73b1bf0467 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:12.521991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 473/951] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:12.528422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:12.537333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b63eb-aff1-4d85-b69e-4f804ab323b7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:12.542063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:12.542949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.543300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.543645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.544912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:12.546698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83aeb-ca48-4326-8f0b-3b17a14c5779 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:12.548486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 479/952] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:12.870375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc897-cc03-45e6-9d4c-ad6ec6d925f0 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.870932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc897-cc03-45e6-9d4c-ad6ec6d925f0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.870932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc897-cc03-45e6-9d4c-ad6ec6d925f0 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.872693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 474/953] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:12.878845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8210-0808-45a7-9114-1b883c88962d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.879298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8210-0808-45a7-9114-1b883c88962d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.879390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e8210-0808-45a7-9114-1b883c88962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.897096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-813e8210-0808-45a7-9114-1b883c88962d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:12.898867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-813e8210-0808-45a7-9114-1b883c88962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:12.906319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 480/954] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:12.932911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fc897-cc03-45e6-9d4c-ad6ec6d925f0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:12.945199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fc897-cc03-45e6-9d4c-ad6ec6d925f0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:12.949500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:12.950280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.950576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.950849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.961335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:12.968444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:35:12.969576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 475/955] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:35:12 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:12.976503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8210-0808-45a7-9114-1b883c88962d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:12.985482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e8210-0808-45a7-9114-1b883c88962d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:12.989959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:12.990633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:12.990912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:12.991185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:12.991936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:12.992237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:12.993804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.001715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 481/956] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:35:12 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:13.008827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.019107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f05756-d29b-4488-9ec4-e09f621b88cf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.024112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.024865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.025141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.025408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.035316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.037141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.053111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:13.054760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 476/957] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:13.061134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.071357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5441-631f-466c-9c3a-e723546dea1c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.075834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.076472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.076754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.077024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.077753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:13.078056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.079704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.091055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 482/958] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:13.097475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.107040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3820-5731-4f83-9830-a2b6bf61698f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.111502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.112268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.112543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.112811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.120448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.122389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.136522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:35:13.137654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 477/959] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:13.144066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.153718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33e3c-3c15-466c-8b8b-24147d67563a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.158171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.158844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.159118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.159383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.160210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:13.160508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.162321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.186157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 483/960] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:13.187441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.197855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42258f2b-00c4-47da-be59-b971d3dcc6dc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.202636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.203405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.203684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.203952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.213827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.215660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.232479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:13.233589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 478/961] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:13.240051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.251006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303c57-4d68-4482-b7e0-87705018d542 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.255640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.256287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.256566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.256872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.257648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:13.257954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.259874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.271781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 484/962] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:13.278760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.288849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cd8d0-b6d8-4a5f-a012-459b4b7d10b3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.293317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.294083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.294359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.294662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.301313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.303275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.315800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:35:13.316927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 479/963] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:13.323380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.332847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757c77-8dd7-4848-ba3b-37a5fc16c4f2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.337869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.338512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.338828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.339105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.339898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:13.340206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.342044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e9256-10e1-4ed4-8396-f4266d4482ca admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.354245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 485/964] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:35:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:13.360905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:13.371122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafc94d-cbd9-472a-bccd-9dc80e25d3de admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:13.375459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:13.376373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:13.376647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:13.376914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/ba81db2c895748f9a356e2ef18055771` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:13.379112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=55aabb50c4eb46c78cdf468b3044ce46, role_id=ba81db2c895748f9a356e2ef18055771)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:13.381684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdffb5-3187-44b3-8653-1f9c2f301a68 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:13.394176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 480/965] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:35:13 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/55aabb50c4eb46c78cdf468b3044ce46/roles/ba81db2c895748f9a356e2ef18055771 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:35:14.248506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc986-1963-4c96-97cb-60d71c8ba3a3 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.249015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc986-1963-4c96-97cb-60d71c8ba3a3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.249015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc986-1963-4c96-97cb-60d71c8ba3a3 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.250784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 486/966] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:14.257423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.257840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.258087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.275538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:14.276704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:14.331088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 481/967] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:14.355797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc986-1963-4c96-97cb-60d71c8ba3a3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.368354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc986-1963-4c96-97cb-60d71c8ba3a3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.372776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.373541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.373821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.374094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.384157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:14.391094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:14.392253 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 487/968] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:14.399015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.407725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6f5dd-dad7-437d-b533-54ace3e10c42 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.412163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.412807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.413083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.413858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.414647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:14.414949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:14.416511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:14.424505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 482/969] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:14.431648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.442260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99702c-af5b-492c-877b-ed85225c3d48 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.446758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.447601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.447877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.448148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] PATH_INFO: `/v3/users/42b013ea893d42bf93b4fc4a1e1e7172` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.460730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] RBAC: Authorizing `identity:get_user(user_id=42b013ea893d42bf93b4fc4a1e1e7172)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:14.462876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:14.464506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 488/970] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/users/42b013ea893d42bf93b4fc4a1e1e7172 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:14.471654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.481956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e755bd-b9ba-4752-8f28-3bcb6de679e3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.486373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.487328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.487605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.487872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.496135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:14.497865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:14.506468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 483/971] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:14.513529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.523513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d892ece-45f4-4f28-a27a-bb804bc6971f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.528009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.528837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.529114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.529382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.530560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:14.532564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289d587-fbff-47d2-a366-1b6258054e6c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:14.534172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 489/972] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:14.541399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:14.550022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be391e7-7ff5-45f9-ae19-d7b19697082f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:14.554519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:14.555172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:14.555457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:14.555728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:14.556560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user.id=42b013ea893d42bf93b4fc4a1e1e7172) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:14.556871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:14.558768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a149dc-3037-42a5-b62a-b3ea8d5d40b7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:14.564771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 484/973] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:14 2021] GET /identity/v3/role_assignments?user.id=42b013ea893d42bf93b4fc4a1e1e7172&scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:15.665295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5b97-beb5-4ffd-a552-d73810c7af7d None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.665826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5b97-beb5-4ffd-a552-d73810c7af7d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.665950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5b97-beb5-4ffd-a552-d73810c7af7d None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.667780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 490/974] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:15.673684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.674178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.674351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.691409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:15.692591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:15.700645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 485/975] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:15.726338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5b97-beb5-4ffd-a552-d73810c7af7d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.738329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5b97-beb5-4ffd-a552-d73810c7af7d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.742653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.743439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.743719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.743993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.753781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:15.761779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 18:35:15.763079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 491/976] 10.222.0.36 () {56 vars in 1141 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:15.769654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.778970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c63863-54c9-45d7-9998-9cdacebd6dff None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.783441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.784087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.784363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.784633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.785389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:15.785695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:15.787302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:15.795185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 486/977] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:15.801417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.811386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6034-121f-4a31-bc6c-9dcb4d33f8f5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.815757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.816511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.816785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.817049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.827307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:15.829106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:15.845421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:15.846579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 492/978] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:15.852852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.862437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7512-53c7-4a46-8993-50517484f00f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.867022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.867776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.868123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.868466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.869266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:15.869657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:15.871323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:15.883375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 487/979] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:15.889797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.899770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815ca0-e079-4975-8444-376fc70458f1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.904268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.905040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.905321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.905596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.912598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:15.914647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:15.927785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 18:35:15.929093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 493/980] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:15.935271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.945128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917b8c1-4d06-481c-b8b3-bac1af554ae1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.949586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.950227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.950503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.950808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:15.951650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:15.951953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:15.953763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:15.970562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 488/981] 10.222.0.36 () {56 vars in 1154 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:15.976977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:15.986352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d472-a726-4f13-8b62-61639e248903 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:15.993251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:15.993869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:15.994145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:15.994417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.001785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.003529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.012652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 494/982] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:16.019018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.028826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d822-21bc-40c4-97ae-8e22c33be2fc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.033215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.033966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.034237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.034503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.044245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.046027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.062283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:35:16.063417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 489/983] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:16.069486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.078742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8b5a5-99c9-4d05-8d92-93dce9f90828 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.083298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.083936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.084216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.084492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.085712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:16.086016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.087616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.103909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 495/984] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:16.105034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.114371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed150-1c98-4711-8952-50f6ddabb76a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.118854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.119607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.119880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.120144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.126767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.128686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.141353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:35:16.142478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 490/985] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:16.149546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.158879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22168ea-3a1a-4d33-8a19-a7b1f38a29fa admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.163927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.164567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.164848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.165116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.165905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:16.166209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.168074 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098ddba-c60c-40dc-994f-c6c88edc6cee admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.179897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 496/986] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:16.186428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.196506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565814c0-95db-47f1-9a06-1d4411dc15b7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.200995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.201608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.201878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.202141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.203062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] RBAC: Adding query filter params (role.id=ba81db2c895748f9a356e2ef18055771, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=55aabb50c4eb46c78cdf468b3044ce46) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:16.203364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.205167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687cf3a-e811-4028-8277-55745ffb5ed5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.211435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 491/987] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/role_assignments?user.id=55aabb50c4eb46c78cdf468b3044ce46&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=ba81db2c895748f9a356e2ef18055771 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:16.801893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8db-e20e-4f8b-a9ee-5c07298f87e9 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.802419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8db-e20e-4f8b-a9ee-5c07298f87e9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.802419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d8db-e20e-4f8b-a9ee-5c07298f87e9 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.804760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 497/988] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:16.810767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.811177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.811315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.828734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:16.829910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:16.837646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 492/989] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:16.864162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d8db-e20e-4f8b-a9ee-5c07298f87e9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.879029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d8db-e20e-4f8b-a9ee-5c07298f87e9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.884194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.885243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.885520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.885788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.896488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:16.903247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:16.904439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 498/990] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:35:16.911364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.920544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae18ad-4a9f-4d62-97e8-d38f11b4ddda None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.925802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.926462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.926769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.927051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.927812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:16.928115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.930209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.938866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 493/991] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:16.945964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.956381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88071f-48b1-46d3-9598-5bfe001387e5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.960989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.961825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.962102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.962373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] PATH_INFO: `/v3/users/42b013ea893d42bf93b4fc4a1e1e7172` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.963595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] RBAC: Authorizing `identity:get_user(user_id=42b013ea893d42bf93b4fc4a1e1e7172)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.965704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.967339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 499/992] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/users/42b013ea893d42bf93b4fc4a1e1e7172 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:16.973692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:16.983412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c94b-818b-43f3-876f-a2ef7b5e66fd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:16.988047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:16.988894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:16.989173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:16.989443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:16.990652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:16.993202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20231-0963-48c6-9979-787ceb2e7e2c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:16.994904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 494/993] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:16 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:17.001617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:17.012554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58e99-08a7-4207-89e3-01bc023d3856 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:17.017081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:17.017945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:17.018227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:17.018500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6/users/42b013ea893d42bf93b4fc4a1e1e7172/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:17.020510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user_id=42b013ea893d42bf93b4fc4a1e1e7172, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:17.023184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b0bc0-2dbf-48eb-8ed8-240b63934a50 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:17.036510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 500/994] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:35:17 2021] PUT /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6/users/42b013ea893d42bf93b4fc4a1e1e7172/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:35:19.262004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419affc0-e5bc-4992-9112-a9938e4dbdeb None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.262503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419affc0-e5bc-4992-9112-a9938e4dbdeb None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.262503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419affc0-e5bc-4992-9112-a9938e4dbdeb None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.264288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 495/995] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:19.270193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.270647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.270767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.288801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:19.289969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:19.341981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 501/996] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:19.366924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419affc0-e5bc-4992-9112-a9938e4dbdeb None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.378638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419affc0-e5bc-4992-9112-a9938e4dbdeb None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.383472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.384230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.384766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.385037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.395316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:19.401929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:19.403081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 496/997] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:19.409398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.418376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153219d-6d4a-4bf8-9cf0-6676ef36a8a8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.422789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.423422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.423697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.423966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.424706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:19.425006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:19.426591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:19.435002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 502/998] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:19.440858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.450081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bee48e-1934-49db-aed1-c8264f06c783 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.454469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.455319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.455596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.455868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] PATH_INFO: `/v3/users/42b013ea893d42bf93b4fc4a1e1e7172` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.457057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] RBAC: Authorizing `identity:get_user(user_id=42b013ea893d42bf93b4fc4a1e1e7172)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:19.459196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:19.460738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 497/999] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/users/42b013ea893d42bf93b4fc4a1e1e7172 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:19.466824 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.476702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a137-1f63-40a7-8f46-095b285f117e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.481240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.481863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.482144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.482418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.489894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:19.492296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:19.500813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 503/1000] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:19.506969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.516656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d98c3-1328-4be1-8c0c-e3237015d9cd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.521268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.522071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.522349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.522655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.523826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:19.525835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4abc0-5d4f-4304-8253-484134efd9d1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:19.527475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 498/1001] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:19.533869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:19.543067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148e37-6ecb-4f8e-a20c-6ac68abee7e5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:19.548529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:19.549316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:19.549851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:19.550344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:19.551551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user.id=42b013ea893d42bf93b4fc4a1e1e7172) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:19.551861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:19.554752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de8e8c-2623-4c64-8e42-d98460266cc8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:19.560771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 504/1002] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:19 2021] GET /identity/v3/role_assignments?user.id=42b013ea893d42bf93b4fc4a1e1e7172&scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:21.800366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d719c2-4027-4b22-ae5b-7ceefbe72f2c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:21.800924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d719c2-4027-4b22-ae5b-7ceefbe72f2c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:21.800924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d719c2-4027-4b22-ae5b-7ceefbe72f2c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:21.802699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 499/1003] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:21.809279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:21.809695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:21.809826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:21.827032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:21.828207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:21.835727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 505/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:21.861364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d719c2-4027-4b22-ae5b-7ceefbe72f2c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:21.873802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d719c2-4027-4b22-ae5b-7ceefbe72f2c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:21.878307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:21.879099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:21.879377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:21.879649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:21.880815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:21.882515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545eef6-792e-49ff-8956-8455e083f3d7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:21.884073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 500/1005] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:21.890326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:21.898852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702dde0-ff35-4d2c-b886-f675719ae856 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:21.903238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:21.903871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:21.904145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:21.904413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:21.905125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:21.907009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b432c-4113-4022-96e0-088e07c8c7d5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:21.925966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 506/1006] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:35:21 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:35:24.213462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9e00-95a8-42de-b736-ebbcec7d8a2b None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.213985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9e00-95a8-42de-b736-ebbcec7d8a2b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.213985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c9e00-95a8-42de-b736-ebbcec7d8a2b None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.215759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 501/1007] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:24.221909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.222312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.222456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.239440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:24.240594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:24.248058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 507/1008] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:24.273098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c9e00-95a8-42de-b736-ebbcec7d8a2b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:24.284885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c9e00-95a8-42de-b736-ebbcec7d8a2b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:24.289172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:24.289974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.290243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.290504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] PATH_INFO: `/v3/roles/ee902deb77954618a3800ef701089e61` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.291979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] RBAC: Authorizing `identity:get_role(role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:24.292971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:35:24.292971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:35:24.292971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:35:24.293827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:24.295117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 502/1009] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:24 2021] GET /identity/v3/roles/ee902deb77954618a3800ef701089e61 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:24.301029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:24.309939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6253c-efa5-4100-81ba-d23f2e7e7eae None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:24.314301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:24.315157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.315429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.315692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] PATH_INFO: `/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.328794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=07c1a3cc2e5c431cabc58a7234e2fd38)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:24.330943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:24.332526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 508/1010] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:24 2021] GET /identity/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:24.338503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:24.347540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837457-9195-4c7f-8bc4-d202151f99b9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:24.351925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:24.352516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.352788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.353056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.360391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:24.362049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:24.370977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 503/1011] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:24.377052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:24.386826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079690e-1072-4228-935b-87f0328675d6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:24.391179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:24.391970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.392244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.392515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.393647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:24.395630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe5d78-5d21-4858-8c38-2bab084b990c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:24.397188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 509/1012] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:24 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:24.403283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:24.411591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c8a5c-9f5d-42a4-b0e7-2e7c4bd65aa4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:24.416110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:24.416714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:24.416991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:24.417261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:24.418068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user.id=07c1a3cc2e5c431cabc58a7234e2fd38) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:24.418372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:24.420165 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e469d-b917-4eca-a52e-c6e369d273e6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:24.425326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 504/1013] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:24 2021] GET /identity/v3/role_assignments?user.id=07c1a3cc2e5c431cabc58a7234e2fd38&scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6&role.id=ee902deb77954618a3800ef701089e61 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:26.654280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0681-b41d-44a1-9143-cdc6b4dac34b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.654846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0681-b41d-44a1-9143-cdc6b4dac34b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.654846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0681-b41d-44a1-9143-cdc6b4dac34b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.656627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 510/1014] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:26.662645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.663105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.663249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.681001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:26.682170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:26.689637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 505/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:26.715829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d0681-b41d-44a1-9143-cdc6b4dac34b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:26.727501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d0681-b41d-44a1-9143-cdc6b4dac34b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:26.731765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:26.732580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.732857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.733123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] PATH_INFO: `/v3/roles/ee902deb77954618a3800ef701089e61` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.734593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] RBAC: Authorizing `identity:get_role(role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:26.735585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:35:26.735585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:35:26.735585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:35:26.736468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:26.737756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 511/1016] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:26 2021] GET /identity/v3/roles/ee902deb77954618a3800ef701089e61 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:26.744245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:26.752721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1992c-570a-4f44-9535-3418799eb55e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:26.757758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:26.758619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.758894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.759162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] PATH_INFO: `/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.760599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] RBAC: Authorizing `identity:get_user(user_id=07c1a3cc2e5c431cabc58a7234e2fd38)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:26.762774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:26.764287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 506/1017] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:26 2021] GET /identity/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:26.769975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:26.779151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a7b9-f40f-4596-870b-ee3d425dbaf1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:26.783636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:26.784426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.784702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.784969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.786113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:26.788163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06be179-d333-4ac8-ad61-3f67797f4407 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:26.789753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 512/1018] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:26 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:26.797111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:26.806755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25a43-bbc9-4e68-914b-68cbe8da151e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:26.811199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:26.812022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:26.812297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:26.812566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6/users/07c1a3cc2e5c431cabc58a7234e2fd38/roles/ee902deb77954618a3800ef701089e61` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:26.814771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user_id=07c1a3cc2e5c431cabc58a7234e2fd38, role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:26.817320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e05b4-e5c0-408d-b5da-ad5f7aa4cedf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:26.838399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 507/1019] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:35:26 2021] PUT /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6/users/07c1a3cc2e5c431cabc58a7234e2fd38/roles/ee902deb77954618a3800ef701089e61 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:35:29.048382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a56df-b1e7-4c7c-9c25-d462baa2632e None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.048852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a56df-b1e7-4c7c-9c25-d462baa2632e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.048943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a56df-b1e7-4c7c-9c25-d462baa2632e None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.050698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 513/1020] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:29.056554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.056983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.057074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.073971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:29.075162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:29.128680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 508/1021] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:29.153458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a56df-b1e7-4c7c-9c25-d462baa2632e None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:29.165362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a56df-b1e7-4c7c-9c25-d462baa2632e None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:29.170436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:29.171318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.171598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.171870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] PATH_INFO: `/v3/roles/ee902deb77954618a3800ef701089e61` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.173380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] RBAC: Authorizing `identity:get_role(role_id=ee902deb77954618a3800ef701089e61)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:29.174992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:29.176318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 514/1022] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:29 2021] GET /identity/v3/roles/ee902deb77954618a3800ef701089e61 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:29.182768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:29.191404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883661c-6256-49d1-bd9b-a234f142f922 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:29.196326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:29.197151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.197422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.197684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] PATH_INFO: `/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.198894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=07c1a3cc2e5c431cabc58a7234e2fd38)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:29.200993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:29.202508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 509/1023] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:29 2021] GET /identity/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:29.208369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:29.218144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e142a-49e0-43c5-afca-c26e799b5db8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:29.222645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:29.223235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.223515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.223786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.231171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:29.232844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:29.241224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 515/1024] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:29.247253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:29.256252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee14f9-457c-46b9-abd0-55cf0dc633e0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:29.261441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:29.262219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.262494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.262791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.263932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:29.265887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf1c0-afc9-43b6-8489-5057acc043a8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:29.267500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 510/1025] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:29 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:29.274117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:29.282285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de669d9-fd94-4eec-916c-0d1d61039fb3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:29.286760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:29.287343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:29.287622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:29.287900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:29.288710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] RBAC: Adding query filter params (role.id=ee902deb77954618a3800ef701089e61, scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6, user.id=07c1a3cc2e5c431cabc58a7234e2fd38) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:29.289019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:29.290833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c83e6-25e9-444a-8b7a-93cc0dddc8e7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:29.296197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 516/1026] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:29 2021] GET /identity/v3/role_assignments?user.id=07c1a3cc2e5c431cabc58a7234e2fd38&scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6&role.id=ee902deb77954618a3800ef701089e61 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:31.533223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101219f-e69d-4639-aadd-4ece8224e1a4 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:31.533810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101219f-e69d-4639-aadd-4ece8224e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:31.533810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101219f-e69d-4639-aadd-4ece8224e1a4 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:31.535570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 511/1027] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:31.541599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:31.541998 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:31.542141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:31.559298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:31.560492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:31.568021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 517/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:31.593475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101219f-e69d-4639-aadd-4ece8224e1a4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:31.605314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101219f-e69d-4639-aadd-4ece8224e1a4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:31.609615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:31.610366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:31.610680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:31.610955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:31.612113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:31.613785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c7058-4da0-4977-9727-2013de783af1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:31.615364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 512/1029] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:31.621215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:31.629695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1592435-88b4-45f4-8fb7-34c0f8849e43 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:31.635104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:31.635736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:31.636016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:31.636288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:31.636999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:31.638907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd65e9-33e0-4a4b-b43e-0b69628790a5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:31.664001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 518/1030] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:35:31 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:33.933452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a903d6-5958-421c-912c-8d01681b8d43 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:33.934009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a903d6-5958-421c-912c-8d01681b8d43 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:33.934009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a903d6-5958-421c-912c-8d01681b8d43 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:33.935763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 513/1031] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:33.941946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:33.942382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:33.942483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:33.961251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:33.962432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:34.016659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 519/1032] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:34.042725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a903d6-5958-421c-912c-8d01681b8d43 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:34.054911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a903d6-5958-421c-912c-8d01681b8d43 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:34.059105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:34.059856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:34.060132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:34.060402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:34.061544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:34.063243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9edf54-5e75-4115-a62b-d2fe883e6071 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:34.064758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 514/1033] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:35:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:34.071247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:34.079767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6794eb-f533-432e-acdc-3cf769581877 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:34.084213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:34.084894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:34.085174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:34.085450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:34.086176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:34.088112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adde88-82f1-4018-968f-dbbaa13e0061 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:34.106879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 520/1034] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:35:34 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:36.421021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d9a2-c4ed-43ab-9707-8f155d7c7b7d None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.421572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d9a2-c4ed-43ab-9707-8f155d7c7b7d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.421572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6d9a2-c4ed-43ab-9707-8f155d7c7b7d None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.423320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 515/1035] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:36.429733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.430109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.430283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.447846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:36.449037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:36.456511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 521/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:36.481059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6d9a2-c4ed-43ab-9707-8f155d7c7b7d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.493352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6d9a2-c4ed-43ab-9707-8f155d7c7b7d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.497651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.498400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.498709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.498978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.509682 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:36.516426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:36.517528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 516/1037] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:36.523831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.532373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ab576-12b1-4450-b579-4c6688a03b1b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.536770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.537404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.537680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.537951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.538739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:36.539043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:36.540610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:36.548363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 522/1038] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:36.554712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.565207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dff18-9d12-4ad4-9a64-5bed5e3cc787 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.570231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.571062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.571339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.571609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] PATH_INFO: `/v3/users/e3b47b5018074c39a39d27d81afa67cb` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.583797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3b47b5018074c39a39d27d81afa67cb)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:36.585962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:36.587548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 517/1039] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/users/e3b47b5018074c39a39d27d81afa67cb => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:36.593632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.602836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba53f35-5271-4dd2-8152-89ff4517b270 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.607221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.607836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.608112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.608382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.616388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:36.618075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:36.626515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 523/1040] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:36.632490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.641625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524e45-b0ab-436a-87fe-94c8731178a1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.645988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.646801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.647576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.647844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] PATH_INFO: `/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.648991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] RBAC: Authorizing `identity:get_project(project_id=b6a6ed2acf4d453ab0393eaa990e61d5)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:36.650986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec45de-80e7-4724-8134-b7ddc1c48503 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:36.652556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 518/1041] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:36.658592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:36.667213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9809-39e1-48a8-8fe0-47d04e959a3e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:36.671592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:36.672128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:36.672403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:36.672672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:36.673471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5, user.id=e3b47b5018074c39a39d27d81afa67cb) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:36.673776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:36.675567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb7bd5-4a1e-4bf2-a1b0-01d9c571142e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:36.680717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 524/1042] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:36 2021] GET /identity/v3/role_assignments?user.id=e3b47b5018074c39a39d27d81afa67cb&scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:38.919004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfb4d-d7d3-4209-8e0d-f2cc4fd7d114 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:38.919564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfb4d-d7d3-4209-8e0d-f2cc4fd7d114 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:38.919564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfb4d-d7d3-4209-8e0d-f2cc4fd7d114 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:38.921301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 519/1043] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:38.927312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:38.927774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:38.927867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:38.945227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:38.946393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:38.953765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 525/1044] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:38.978022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbfb4d-d7d3-4209-8e0d-f2cc4fd7d114 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:38.992116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbfb4d-d7d3-4209-8e0d-f2cc4fd7d114 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:38.996340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:38.997095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:38.997367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:38.997632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:39.007898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:39.014793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:39.015906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 520/1045] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:39.023075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:39.031748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862187f-7284-4ed4-b048-9b67c15a9885 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:39.036197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:39.036840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:39.037118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:39.037391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:39.038143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:39.038447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:39.040044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:39.047977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 526/1046] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:39.053946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:39.063634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba226f1-6566-476d-8505-b053a59b96ce admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:39.068039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:39.069342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:39.069614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:39.069881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] PATH_INFO: `/v3/users/e3b47b5018074c39a39d27d81afa67cb` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:39.071089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3b47b5018074c39a39d27d81afa67cb)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:39.073158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:39.074687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 521/1047] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:39 2021] GET /identity/v3/users/e3b47b5018074c39a39d27d81afa67cb => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:39.080465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:39.090030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fe5e2-75f6-46f4-b528-79de7fcdb9cc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:39.094480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:39.095315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:39.095594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:39.095867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] PATH_INFO: `/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:39.097014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] RBAC: Authorizing `identity:get_project(project_id=b6a6ed2acf4d453ab0393eaa990e61d5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:39.099041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec26e1f-f7a1-445b-9e03-23132c32251e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:39.100611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 527/1048] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:39 2021] GET /identity/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:39.106518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:39.115454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a9f58-4d4e-493c-bfb1-790a707046c6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:39.119846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:39.120643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:39.120914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:39.121179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] PATH_INFO: `/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5/users/e3b47b5018074c39a39d27d81afa67cb/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:39.123099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a6ed2acf4d453ab0393eaa990e61d5, user_id=e3b47b5018074c39a39d27d81afa67cb, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:39.125610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3cf09-9565-4a0a-92ee-7b3f1ba0c8f1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:39.138734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 522/1049] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:35:39 2021] PUT /identity/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5/users/e3b47b5018074c39a39d27d81afa67cb/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:35:41.349627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861b73-21c6-42ba-8c34-ab03dac9678d None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.350690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861b73-21c6-42ba-8c34-ab03dac9678d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.350842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861b73-21c6-42ba-8c34-ab03dac9678d None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.352602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 528/1050] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:41.358707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.359110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.359254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.376880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:41.378049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:41.432474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 523/1051] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:41.456396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861b73-21c6-42ba-8c34-ab03dac9678d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.467979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861b73-21c6-42ba-8c34-ab03dac9678d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.472254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.473006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.473278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.473544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.483774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:41.490398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:41.492063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 529/1052] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:41.498295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.506860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0ccb-3a5d-4ce4-8520-b08c93626645 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.511582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.512214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.512492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.512764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.513507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:41.513807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:41.515415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:41.523786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 524/1053] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:41.529727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.539990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f149-6f33-40c2-b45f-1dc8e65b4eea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.544427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.545231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.545507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.545776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] PATH_INFO: `/v3/users/e3b47b5018074c39a39d27d81afa67cb` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.546988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] RBAC: Authorizing `identity:get_user(user_id=e3b47b5018074c39a39d27d81afa67cb)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:41.549059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:41.550595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 530/1054] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/users/e3b47b5018074c39a39d27d81afa67cb => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:41.556391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.565319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d53e91-0d16-4506-b296-f82a397c3df0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.569751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.570354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.570667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.570939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.578290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:41.580086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:41.589076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 525/1055] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:41.594990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.604572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94c6c1-f665-48f6-ac8b-eaf583fb958a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.608959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.609740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.610019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.610290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] PATH_INFO: `/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.611470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] RBAC: Authorizing `identity:get_project(project_id=b6a6ed2acf4d453ab0393eaa990e61d5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:41.613437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3250175-03b7-47ad-906a-6e185faa6706 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:41.615169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 531/1056] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:41.621058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:41.629195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368337-fa82-46fa-b3b4-7b91a0ed3e63 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:41.633618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:41.634470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:41.634777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:41.635050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:41.635855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5, user.id=e3b47b5018074c39a39d27d81afa67cb) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:41.636159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:41.637904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2d5d-ad92-4b5b-b5d3-52c152d5ec6d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:41.643411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 526/1057] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:41 2021] GET /identity/v3/role_assignments?user.id=e3b47b5018074c39a39d27d81afa67cb&scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:43.868743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489940f-b367-4de8-b8eb-17e34e87f4d9 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:43.869300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489940f-b367-4de8-b8eb-17e34e87f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:43.869300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489940f-b367-4de8-b8eb-17e34e87f4d9 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:43.871055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 532/1058] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:43.876873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:43.877295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:43.877413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:43.895433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:43.896594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:43.904024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 527/1059] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:43.926668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489940f-b367-4de8-b8eb-17e34e87f4d9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:43.938780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489940f-b367-4de8-b8eb-17e34e87f4d9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:43.943025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:43.943681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:43.943961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:43.944230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:43.951516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:43.953216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:43.962057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 533/1060] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:43.968195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:43.976804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb7d2-4b0d-4734-a1ed-a82ac28db03c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:43.981229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:43.981992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:43.982262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:43.982521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:43.989415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:43.991774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:44.005952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-1bb5277b-5dae-4193-8c54-3366168bdda2 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 18 18:35:44.007687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 528/1061] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:35:43 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:44.014417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:44.023112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2418e-9f96-4589-ade2-d16b5396ac06 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:44.027565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:44.028183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:44.028460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:44.028726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:44.029441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:44.029739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:44.031320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afe5e0-f86a-4e02-a058-b206b0c14567 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:44.038166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 534/1062] 10.222.0.36 () {56 vars in 1136 bytes} [Mon Oct 18 18:35:44 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:46.251764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3f64-d0b9-463e-89c9-cab620e6f4af None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:46.252291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3f64-d0b9-463e-89c9-cab620e6f4af None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:46.252291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3f64-d0b9-463e-89c9-cab620e6f4af None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:46.253961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 529/1063] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:46.260386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a63-38a8-4290-ad0a-1a7f2dec749e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:46.260771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a63-38a8-4290-ad0a-1a7f2dec749e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:46.260929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73a63-38a8-4290-ad0a-1a7f2dec749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:46.278404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1ad73a63-38a8-4290-ad0a-1a7f2dec749e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:46.279639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1ad73a63-38a8-4290-ad0a-1a7f2dec749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:46.287179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 535/1064] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:46.314529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3f64-d0b9-463e-89c9-cab620e6f4af None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:46.326448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3f64-d0b9-463e-89c9-cab620e6f4af None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:46.330696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:46.331336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:46.331610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:46.331876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:46.332626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:46.333618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:35:46.333618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:35:46.333618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:35:46.335021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a4a29-ba62-46dd-bd85-61b82d7ac6a6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:46.348394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 530/1065] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 18 18:35:46 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:48.592908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155278b7-4da7-4467-86fd-31b0bd21501e None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:48.593463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155278b7-4da7-4467-86fd-31b0bd21501e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:48.593463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155278b7-4da7-4467-86fd-31b0bd21501e None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:48.595308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 536/1066] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:48.601218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:48.601655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:48.601768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:48.619863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:48.621162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:48.676030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 531/1067] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:48.702256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155278b7-4da7-4467-86fd-31b0bd21501e None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:48.716253 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155278b7-4da7-4467-86fd-31b0bd21501e None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:48.720588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:48.721499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:48.721783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:48.722290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] PATH_INFO: `/v3/domains/ec4fa1907c114deeaf751fb82427b7de` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:48.735207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ec4fa1907c114deeaf751fb82427b7de)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:48.737141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dd9d0-aa19-4fe7-b47d-74f391a9fe5f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:48.738765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 537/1068] 10.222.0.36 () {56 vars in 1204 bytes} [Mon Oct 18 18:35:48 2021] GET /identity/v3/domains/ec4fa1907c114deeaf751fb82427b7de => generated 267 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:48.745649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:48.754646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fc8fd-39ed-4f64-8405-0eedb3c72c40 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:48.759333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:48.759961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:48.760231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:48.760494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:48.761201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:48.763098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac291e8-a9ce-48c4-9215-7709007e6655 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:48.788120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 532/1069] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:35:48 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:35:51.061968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580e6a-2d78-489e-a167-4f052b931bbf None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:51.062437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580e6a-2d78-489e-a167-4f052b931bbf None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:51.062528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580e6a-2d78-489e-a167-4f052b931bbf None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:51.064279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 538/1070] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:51.070273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:51.070720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:51.070851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:51.088076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:51.089258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:51.143920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 533/1071] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:51.169342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580e6a-2d78-489e-a167-4f052b931bbf None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:51.181504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580e6a-2d78-489e-a167-4f052b931bbf None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:51.185764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:51.186610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:51.186890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:51.187251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] PATH_INFO: `/v3/domains/ec4fa1907c114deeaf751fb82427b7de` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:51.188414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ec4fa1907c114deeaf751fb82427b7de)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:51.190305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969491ab-1209-411d-8991-b1e8ca977ca1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:51.191852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 539/1072] 10.222.0.36 () {56 vars in 1204 bytes} [Mon Oct 18 18:35:51 2021] GET /identity/v3/domains/ec4fa1907c114deeaf751fb82427b7de => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:51.197809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:51.206337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691af8-e7b4-4980-8473-4247e442e7cb None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:51.210870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:51.211502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:51.211778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:51.212044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:51.212757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:51.214669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4376f-1f34-4a6b-a3e0-2fb39a2f1a82 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:51.234415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 534/1073] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:35:51 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:35:53.496877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a796-d159-47d1-8b22-aa5ebfb9f6f7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.497412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a796-d159-47d1-8b22-aa5ebfb9f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.497412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35a796-d159-47d1-8b22-aa5ebfb9f6f7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.499229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 540/1074] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:53.505231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.505613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.506271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.524030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:53.525188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:53.532597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 535/1075] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:53.556825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35a796-d159-47d1-8b22-aa5ebfb9f6f7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.569154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35a796-d159-47d1-8b22-aa5ebfb9f6f7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.573521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.574268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.574568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.574854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.585186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:53.591896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:53.593007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 541/1076] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:53.599184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.607703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65691f-a93a-43e5-b66c-4559cbeb29f4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.612166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.612788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.613061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.613326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.614064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:53.614362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:53.616499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:53.624326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 536/1077] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:53.630271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.639785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce490650-45ad-4e14-8a13-49dac87becd9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.644243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.645043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.645320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.645590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] PATH_INFO: `/v3/users/45ab1880190f40abb866cd8a7fd1fe70` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.659167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] RBAC: Authorizing `identity:get_user(user_id=45ab1880190f40abb866cd8a7fd1fe70)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:53.661271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:53.663528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 542/1078] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/users/45ab1880190f40abb866cd8a7fd1fe70 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:53.669885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.679312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c41-b859-47c1-a963-97a90b8024f8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.683770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.684391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.684672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.684946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.692380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:53.694105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:53.702610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 537/1079] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:53.708592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.718274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83301546-4615-4fb7-ab34-c70aa2816a6c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.722714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.723522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.723801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.724073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] PATH_INFO: `/v3/projects/456843f09d59426cb94a98f47c2e56a7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.725829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] RBAC: Authorizing `identity:get_project(project_id=456843f09d59426cb94a98f47c2e56a7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:53.727836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ea750-0e14-4b25-8301-dd8037c8ad8e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:53.729418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 543/1080] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/projects/456843f09d59426cb94a98f47c2e56a7 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:53.735728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:53.744059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf67b-7d5c-4027-8780-834c7c45cbcd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:53.748581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:53.749117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:53.749398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:53.749670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:53.750480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=456843f09d59426cb94a98f47c2e56a7, user.id=45ab1880190f40abb866cd8a7fd1fe70) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:53.750821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:53.752583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734e5c-c96d-4698-886d-419ac6e88cc0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:53.757801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 538/1081] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:53 2021] GET /identity/v3/role_assignments?user.id=45ab1880190f40abb866cd8a7fd1fe70&scope.project.id=456843f09d59426cb94a98f47c2e56a7&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:55.971459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37255f-a473-4f45-af0f-8e721a2d59f8 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:55.972001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37255f-a473-4f45-af0f-8e721a2d59f8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:55.972001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37255f-a473-4f45-af0f-8e721a2d59f8 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:55.973772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 544/1082] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:55.980038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:55.980531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:55.980625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:55.998467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:55.999676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:56.007929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 539/1083] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:35:56.035295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37255f-a473-4f45-af0f-8e721a2d59f8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:56.047195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37255f-a473-4f45-af0f-8e721a2d59f8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:56.051529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:56.052292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:56.053056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:56.053339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:56.063170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:56.070473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:56.071616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 545/1084] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:56.078098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:56.086771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5d6ac-0b89-4f4e-9e41-b3fd84d4586c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:56.091190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:56.091827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:56.092104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:56.092376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:56.093129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:56.093430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:56.095031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:56.102900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 540/1085] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:56.108897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:56.119088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df47d-1068-437a-a5ac-07da478f2130 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:56.123539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:56.124341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:56.124621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:56.124891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] PATH_INFO: `/v3/users/45ab1880190f40abb866cd8a7fd1fe70` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:56.126064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] RBAC: Authorizing `identity:get_user(user_id=45ab1880190f40abb866cd8a7fd1fe70)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:56.128218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:56.129743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 546/1086] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:56 2021] GET /identity/v3/users/45ab1880190f40abb866cd8a7fd1fe70 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:56.136537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:56.145546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4a692-4afa-4254-abef-f1bba34b2c70 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:56.149965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:56.150791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:56.151073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:56.151344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] PATH_INFO: `/v3/projects/456843f09d59426cb94a98f47c2e56a7` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:56.152500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] RBAC: Authorizing `identity:get_project(project_id=456843f09d59426cb94a98f47c2e56a7)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:56.154468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7510e-a38b-4f68-9cc1-0f1f0c135e26 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:56.156075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 541/1087] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:56 2021] GET /identity/v3/projects/456843f09d59426cb94a98f47c2e56a7 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:56.162473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:56.171501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79944f2-c7a0-447a-871e-f3fd090f9788 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:56.175919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:56.176727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:56.177004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:56.177274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] PATH_INFO: `/v3/projects/456843f09d59426cb94a98f47c2e56a7/users/45ab1880190f40abb866cd8a7fd1fe70/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:56.179771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=456843f09d59426cb94a98f47c2e56a7, user_id=45ab1880190f40abb866cd8a7fd1fe70, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:56.182307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd17a0e-0301-417e-b04a-8a5e9262a017 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:56.194736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 547/1088] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:35:56 2021] PUT /identity/v3/projects/456843f09d59426cb94a98f47c2e56a7/users/45ab1880190f40abb866cd8a7fd1fe70/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:35:58.405219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ee6d-0b67-441e-91c6-d87a89be9ee5 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.405746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ee6d-0b67-441e-91c6-d87a89be9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.405746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ee6d-0b67-441e-91c6-d87a89be9ee5 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.407524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 542/1089] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:35:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:35:58.413855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.414296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.414391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.431960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:35:58.433118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:35:58.485284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 548/1090] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:35:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:35:58.509788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ee6d-0b67-441e-91c6-d87a89be9ee5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.521367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ee6d-0b67-441e-91c6-d87a89be9ee5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.525574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.526322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.526622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.526893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.536520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:35:58.543699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:35:58.544984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 543/1091] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:35:58.551205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.560211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4629-fec4-4430-a120-1bfd1b8a99c0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.564619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.565254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.565529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.565798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.566561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:58.566872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:58.568439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:58.576192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 549/1092] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:58.582274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.592769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9674a-6d53-4968-87cd-1e0322c25067 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.597230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.598037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.598312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.598611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] PATH_INFO: `/v3/users/45ab1880190f40abb866cd8a7fd1fe70` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.600298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] RBAC: Authorizing `identity:get_user(user_id=45ab1880190f40abb866cd8a7fd1fe70)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:58.602364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:58.603925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 544/1093] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/users/45ab1880190f40abb866cd8a7fd1fe70 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:35:58.609696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.619198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7020474-f722-4532-8f89-af07ca255e61 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.623552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.624142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.624417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.624687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.632039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:58.633721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:58.642528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 550/1094] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:35:58.648286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.657290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e8ab6-6db5-45a0-a3b1-643a996b1d02 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.661620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.662935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.663210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.663481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] PATH_INFO: `/v3/projects/456843f09d59426cb94a98f47c2e56a7` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.664632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] RBAC: Authorizing `identity:get_project(project_id=456843f09d59426cb94a98f47c2e56a7)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:58.666606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14411e54-66ac-48f8-9d27-9e1a27f66760 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:58.668170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 545/1095] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/projects/456843f09d59426cb94a98f47c2e56a7 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:35:58.674024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:35:58.682367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91d22-8300-4fb6-8b57-9172de9c5856 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:35:58.686808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:35:58.687400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:35:58.687679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:35:58.687948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:35:58.688755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=456843f09d59426cb94a98f47c2e56a7, user.id=45ab1880190f40abb866cd8a7fd1fe70) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:35:58.689060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:35:58.690864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bd5b-8e20-413c-83f3-4d683e90cb7f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:35:58.696870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 551/1096] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:35:58 2021] GET /identity/v3/role_assignments?user.id=45ab1880190f40abb866cd8a7fd1fe70&scope.project.id=456843f09d59426cb94a98f47c2e56a7&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:53.804233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647346-c432-48c3-a61e-67b980b47c6e None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:53.804837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647346-c432-48c3-a61e-67b980b47c6e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:53.804837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647346-c432-48c3-a61e-67b980b47c6e None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:53.806694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 546/1097] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:36:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:36:53.812766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:53.813220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:53.813316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:53.837498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:36:53.838923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:36:53.847234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 552/1098] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:36:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:36:53.873695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32647346-c432-48c3-a61e-67b980b47c6e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:53.887826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32647346-c432-48c3-a61e-67b980b47c6e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:53.892604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:53.893384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:53.893659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:53.893931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:53.908576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:53.910457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:53.929003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:36:53.936007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 547/1099] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:53.939848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:53.950495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5be71e-bc68-4458-9197-814117a629bd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:53.955474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:53.956133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:53.956428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:53.956686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:53.957988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:53.958314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:53.959917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf43ce-e2e1-4f03-b2d3-00bcea23fa74 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:53.971894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 553/1100] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:36:53.978577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:53.989038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1cc1-0c0a-45f7-857a-b45b545fb88b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:53.997890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:53.998618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:53.998875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:53.999158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:53.999889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:54.001801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459732-c599-4a83-a600-26da85fff898 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:54.028124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 548/1101] 10.222.0.36 () {60 vars in 1153 bytes} [Mon Oct 18 18:36:53 2021] POST /identity/v3/users => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:36:56.470600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41057-d57a-4d02-a066-9c229837ce3c None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.471215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41057-d57a-4d02-a066-9c229837ce3c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.471215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41057-d57a-4d02-a066-9c229837ce3c None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.473504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 554/1102] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:36:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:36:56.482667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.482667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.482667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.501799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:36:56.503228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:36:56.513050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 549/1103] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:36:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:36:56.540211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41057-d57a-4d02-a066-9c229837ce3c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.553286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41057-d57a-4d02-a066-9c229837ce3c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.557736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.558600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.558919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.559202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.571491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:36:56.578675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:36:56.580049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 555/1104] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:56.588311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.598282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bc2c-ba7d-48ad-8507-b36117abb2ed None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.603503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.604447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.604730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.605151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.606082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:56.606392 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.608012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.616915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 550/1105] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:36:56.624429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.635403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bce88f-8db9-4bec-85d6-228ee0fe2455 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.640549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.641278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.641765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.641971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.654631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.656668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.682187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:36:56.683910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 556/1106] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:56.691302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.705890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42771fd1-296a-431e-9cfe-22032eab82be admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.712069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.713409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.713532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.713810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.714917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:56.715373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.717843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.736285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 551/1107] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:56.741340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.752661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793a47-17b3-4596-9353-a5213f856b07 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.758966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.759847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.760151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.760463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.769115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.771244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.786779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:36:56.793535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 557/1108] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:56.795203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.807777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d223a7-10c8-47fe-a55c-9782a604f7d6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.813646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.814397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.814703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.814999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.815906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:56.816313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.818508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.841305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 552/1109] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:56.847778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.858625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d593d6-ea86-4fb6-924e-1fe79383a2eb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.864789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.865648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.865922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.866226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.875128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.877412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.893637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 558/1110] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:36:56.896490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.907671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cbc5f-87bd-441f-9673-202f46e77ad4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.913214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.914084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.914412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.915334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.926767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.928755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.950273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:36:56.957875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 553/1111] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:56.961069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:56.970596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90126-4ae8-4988-bdf7-e84d8103f003 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:56.978620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:56.978620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:56.978620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:56.978620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:56.979047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:56.979322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:56.981286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:56.999285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 559/1112] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:57.001601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:57.012606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736bfe5-ea91-4def-ac44-5a40a4531c0e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:57.017672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:57.018448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:57.018756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:57.019075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:57.026778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:57.029163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:57.043973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:36:57.045439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 554/1113] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:36:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:57.052772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:57.063117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91efed-878c-473c-a827-8030ee2371f5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:57.068361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:57.069821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:57.069821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:57.069821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:57.070602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:57.071633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:57.073057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97246e59-df7c-407d-ac65-6c686af968da admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:57.088295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 560/1114] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:36:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:57.095789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:57.106729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269969-1717-42a7-89c3-b477c6ea4008 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:57.111675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:57.112690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:57.112690 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:57.112882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:57.113694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=047a6b4b18904ee08f9c348948c1e795) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:57.114004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:57.115865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834ab4b-f400-420d-b27c-a77f622bb2da admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:57.121515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 555/1115] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:36:57 2021] GET /identity/v3/role_assignments?user.id=047a6b4b18904ee08f9c348948c1e795&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:59.474467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f632-326b-4d5d-a35b-6bcb80909132 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.475069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f632-326b-4d5d-a35b-6bcb80909132 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.475069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f632-326b-4d5d-a35b-6bcb80909132 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.476953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 561/1116] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:36:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:36:59.485569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.485569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.485569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.507722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:36:59.509635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:36:59.522609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 556/1117] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:36:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:36:59.547737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f632-326b-4d5d-a35b-6bcb80909132 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.560526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f632-326b-4d5d-a35b-6bcb80909132 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.565148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.565919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.566196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.566488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.578327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:36:59.585671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:36:59.587066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 562/1118] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:59.593635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.602740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6d2c-f5f7-43ee-8a7a-2ebd11c13b17 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.607341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.608020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.608276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.608523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.609273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:59.609570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.611188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.620375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 557/1119] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:36:59.627189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.638033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0061-3d1a-470e-979e-43485bb9f897 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.643657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.644415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.645214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.645485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.655748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.657565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.675736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:36:59.683330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 563/1120] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:36:59.684861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.696808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c7e1-fbc2-4232-aacd-3e9bd7ce22cf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.702782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.703559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.703945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.704321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.705194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:59.705580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.707927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.720136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 558/1121] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:36:59.726584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.736063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20860-dd91-4928-a37c-1deca5391618 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.741108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.741890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.742168 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.742449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.751400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.753986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.771599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:36:59.773187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 564/1122] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:36:59.780086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.792236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b47a-d3a7-46e0-b64f-de6a0b7b740f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.797811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.798577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.798901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.799212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.800317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:59.800702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.803340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.821911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 559/1123] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:59.828062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.838920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea8bb-77bc-45ae-9bf9-8f8fcced8985 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.843625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.844461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.844742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.845012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.855565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.857378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.874670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:36:59.875857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 565/1124] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:59.882345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.892311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6ee7-095c-4b86-b822-ff88c9e1f085 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.898792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.899453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.899729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.900000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.900760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:59.901034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.902654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.915184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 560/1125] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:36:59.921542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.932571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb0ae-19e7-4142-9fd7-1ca0c5299e07 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.938298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.939344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.939777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.940088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.948277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.952059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:36:59.967783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:36:59.974896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 566/1126] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:36:59.976127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:36:59.986241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4a83a-96a7-47f8-acdc-f1a0128e93c6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:36:59.991331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:36:59.992681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:36:59.992681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:36:59.992681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:36:59.993246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:36:59.993551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:36:59.995417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ec8a-9b3e-41ca-bf38-6556db86a5d9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:00.008463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 561/1127] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:36:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:00.015077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:00.026660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1842c-af28-4214-b41c-50b0db4b69ea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:00.032770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:00.033905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:00.034205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:00.034482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/047a6b4b18904ee08f9c348948c1e795/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:00.052471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=047a6b4b18904ee08f9c348948c1e795, role_id=6e44dc371cd04545b8cdaa4fc8b7b3d4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:00.055565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20d89a-718d-4e57-a43c-2e0ce25b8385 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:00.071185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 567/1128] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:37:00 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/047a6b4b18904ee08f9c348948c1e795/roles/6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:37:02.320003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a853-44dc-b08c-2f23f007e746 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.320600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a853-44dc-b08c-2f23f007e746 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.320600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a853-44dc-b08c-2f23f007e746 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.322337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 562/1129] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:02.328261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.328712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.328809 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.349626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:02.350972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:02.418496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 568/1130] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:02.443055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b18b-a853-44dc-b08c-2f23f007e746 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.454946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b18b-a853-44dc-b08c-2f23f007e746 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.460023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.460793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.461067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.461331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.471318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:37:02.478008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 18:37:02.485981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.490010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 563/1131] 10.222.0.36 () {56 vars in 1123 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:02.495290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d850d4-1f6e-444c-a136-c2c685a62981 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.500530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.501416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.501553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.501729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.502566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] RBAC: Adding query filter params (name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.502896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.505010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.514014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 569/1132] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:02.520963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.531233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879dfa6-e1e5-4f54-8521-18ceb68017ea admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.536211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.536983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.537264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.537559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.549754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.552656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.569483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:02.570719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 564/1133] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:02.577111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.587279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91768b0-86bd-4c3d-90bc-f3cde8eda167 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.592058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.592680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.592961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.593233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.593960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.594262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.595866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.609174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 570/1134] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:02.616244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.627019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112228c-f417-48bf-a55a-aad0166a2af5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.632264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.633066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.633602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.633877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.643055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.645739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.661394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:37:02.662561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 565/1135] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:02.669558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.680408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906979-e4a3-48fb-b2d4-09ddffbb408b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.685186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.685816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.686095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.686373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.687244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.687560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.689386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.711519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 571/1136] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:02.718566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.728641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c50d8-3b35-4414-b962-ac3f4b635e2d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.733595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.734292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.734513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.734805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.743725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.745554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.760702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 566/1137] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:37:02.767239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.776898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bac1-0c88-471c-bede-bb0fcc36fbc2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.782902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.783690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.783949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.784217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.794230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.796073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.812988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:02.814149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 572/1138] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:02.821159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.830677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aacf65-d4ae-434b-b38f-c837f37cb56d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.836316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.837179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.837527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.837801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.838617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.839058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.841047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.854132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 567/1139] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:02.860559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.870666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6972a-31b7-490f-b7b1-258404bfe6dd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.876041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.876901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.877212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.877560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.886150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.888757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.904611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:37:02.906040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 573/1140] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:02.912714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.922124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800d51c-f00a-461d-9cd0-790137effb24 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.926676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.928568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.928568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.928568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.928877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.928963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.930752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785e85b-0e95-44af-9a48-a265fc73bb5b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.943360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 568/1141] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:02.950286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:02.962953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b16c4-17c3-4d18-b2e0-5367ac605c85 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:02.968069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:02.968912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:02.969325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:02.969684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:02.970900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] RBAC: Adding query filter params (role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=047a6b4b18904ee08f9c348948c1e795) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:02.971295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:02.974120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ade704-9872-4acd-a50a-01e2fa3cc20e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:02.998577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 574/1142] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:37:02 2021] GET /identity/v3/role_assignments?user.id=047a6b4b18904ee08f9c348948c1e795&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=6e44dc371cd04545b8cdaa4fc8b7b3d4 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:05.490988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2758e3-bf87-4114-b479-948a6a3d06ed None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.491581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2758e3-bf87-4114-b479-948a6a3d06ed None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.491581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2758e3-bf87-4114-b479-948a6a3d06ed None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.493264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 569/1143] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:37:05.500738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.501219 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.501502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.520823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:05.522039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:05.530267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 575/1144] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:05.554806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2758e3-bf87-4114-b479-948a6a3d06ed None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.567397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2758e3-bf87-4114-b479-948a6a3d06ed None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.572006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.572775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.573102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.573317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.585840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:37:05.592466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:37:05.593625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 570/1145] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:05.601465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.610984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f18943-1fbd-4c55-bfd0-2b2714d3c42a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.615868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.616524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.616800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.617080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.617839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:05.618137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.619754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.628342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 576/1146] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:05.635617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.646114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b137d-ecde-48c5-b5b3-86ebe009b323 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.651645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.652418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.652731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.653139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.665465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.667372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.684815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:05.685990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 571/1147] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:05.693139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.703613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896384a2-6ffb-464c-b6ca-2419be7cef96 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.709281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.709955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.710235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.710508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.711264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:05.711566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.713266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.724909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 577/1148] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:05.731409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.741208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31609-b746-4f02-bf86-a1ec01a7ffa6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.745813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.746617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.746894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.747161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.755573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.757572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.771932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:37:05.773111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 572/1149] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:05.779649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.789252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa60d52-ea84-4220-86e5-b7749d2cbacb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.794248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.794957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.795232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.795507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.796349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:05.796658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.798485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.819675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 578/1150] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:05.826330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.839605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c007aa-2e87-4615-b771-9b524b3342ae admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.844903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.845711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.845994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.846267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.854098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.856158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.866358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 573/1151] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:37:05.872971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.884636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e42b8-b329-4c70-af2d-94dabaa14698 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.890208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.891091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.891474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.891830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.904189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.906453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.924047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:05.925197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 579/1152] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:05.931990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.942155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc6a6d-20f4-4c0f-9a7d-16b7767c2a27 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.947386 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.948363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.948670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.948940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.949808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:05.950209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:05.952348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:05.967324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 574/1153] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:05.974689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:05.984795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78e945-cb6b-4726-9d03-5f022116245f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:05.989801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:05.990812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:05.991197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:05.991523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:05.999362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:06.001527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:06.017133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:37:06.018702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 580/1154] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:37:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:06.025931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:06.036122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4005e-b3f3-4d3e-997d-3dd654a1a92a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:06.040846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:06.041481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:06.041754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:06.042018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:06.042825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:06.043159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:06.044940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415fb88-2839-4b14-bcf3-e7322fbb4ff6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:06.056255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 575/1155] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:37:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:06.063290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:06.073800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2991a30-2cf7-4cd1-8f91-aab79163a125 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:06.078428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:06.079092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:06.079373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:06.079648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:06.080492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=047a6b4b18904ee08f9c348948c1e795) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:06.080802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:06.083212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99912-445f-4713-ba0e-da67fa1287a9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:06.089702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 581/1156] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:37:06 2021] GET /identity/v3/role_assignments?user.id=047a6b4b18904ee08f9c348948c1e795&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:08.338240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229674-61d5-4ff4-9a3c-1531186860e4 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.338838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229674-61d5-4ff4-9a3c-1531186860e4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.338838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229674-61d5-4ff4-9a3c-1531186860e4 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.340567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 576/1157] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:08.346901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.347388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.347500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.366487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:08.367803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:08.376218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 582/1158] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:08.407633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20229674-61d5-4ff4-9a3c-1531186860e4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.421509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20229674-61d5-4ff4-9a3c-1531186860e4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.426130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.426953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.427281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.427592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.439401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:37:08.447014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:37:08.448488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 577/1159] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:08.455841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.465709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98e71-1884-4afe-b6a5-3db98427261c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.470513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.471195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.471469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.471736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.472487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:08.473321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.474933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.483854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 583/1160] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:08.492098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.505064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7880-518e-4409-86e9-a509ac39192b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.510588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.511807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.511807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.511807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.525907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.528600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.548274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:08.549499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 578/1161] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:08.556949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.568065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13272-d20e-4c86-8605-ecadfd53fe63 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.572813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.573470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.573748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.574024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.574795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:08.575104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.576699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.593871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 584/1162] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:08.595002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.605452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eccbf-8eab-4a7b-991d-3add83f7ff21 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.610036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.610839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.611117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.611387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.621785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.623869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.638251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:37:08.639607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 579/1163] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:08.646348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.656664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0cb8e-5b21-4f04-93f1-15955138d1b1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.661947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.662842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.663208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.663537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.664448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:08.664866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.667257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.687462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 585/1164] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:08.693772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.703454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a2d5-6399-4320-921c-462ac2584f1c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.708276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.709078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.709392 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.709705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.721805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.724252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.744485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:08.745961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 580/1165] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:08.752698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.764116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974e3c9-6335-4a27-b439-119894b6c850 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.768724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.769374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.769633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.769909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.770673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:08.771066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.772676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.784236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 586/1166] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:08.791364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.802204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc89cf-400a-438b-9be1-48937a3275de admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.806861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.807626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.807902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.808205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.815192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.817188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.829927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:37:08.831212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 581/1167] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 18:37:08.837950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.848192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97869a-ed1d-4921-853e-46afb38bce15 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.852843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.853487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.853792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.854060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.854891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:08.855195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.857046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e0ef1-cf0a-4c52-9f17-14f1b185ba9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.870959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 587/1168] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:37:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:08.877698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:08.889610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6a2-c917-4995-8a9a-5f4e21bed26a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:08.894388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:08.895446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:08.895731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:08.896092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] PATH_INFO: `/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/047a6b4b18904ee08f9c348948c1e795/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:08.898471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8522db1b9b414ba3ce0a28f49e707a, user_id=047a6b4b18904ee08f9c348948c1e795, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:08.901657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7dc50-eaee-4f0f-a176-d112a5bb9bce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:08.916339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 582/1169] 10.222.0.36 () {58 vars in 1460 bytes} [Mon Oct 18 18:37:08 2021] PUT /identity/v3/projects/7f8522db1b9b414ba3ce0a28f49e707a/users/047a6b4b18904ee08f9c348948c1e795/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:37:11.226330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa41f-6dff-45c6-8ce9-502e1ddfe3b6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.226898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa41f-6dff-45c6-8ce9-502e1ddfe3b6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.227008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa41f-6dff-45c6-8ce9-502e1ddfe3b6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.228705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 588/1170] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:11.234620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.235055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.235149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.252328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:11.253451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:11.307761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 583/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:11.332311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfa41f-6dff-45c6-8ce9-502e1ddfe3b6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.343980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfa41f-6dff-45c6-8ce9-502e1ddfe3b6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.348875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.349629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.349907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.350206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.359971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 18:37:11.366643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 18:37:11.367763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 589/1172] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:11.373818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.382428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65a36-d3ae-40ae-8aac-80bc77db5c62 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.387116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.387751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.388031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.388301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.389050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.389353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.390969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.399388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 584/1173] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:11.405232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.416371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e483a-245b-4b77-b321-ffa076d30387 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.420764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.421499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.421776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.422047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.431672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.433465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.449235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:11.450314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 590/1174] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:11.456173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.465700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583803e-6332-4e2a-a46e-ef0f19455436 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.470206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.470859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.471134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.471404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.472111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.472987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.474529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.486357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 585/1175] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:11.492479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.503300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d2bd-637b-42d9-b7f9-b87b628ae28e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.508647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.509458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.509709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.509980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] PATH_INFO: `/v3/users/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.517782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.520385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.537391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 18:37:11.539311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 591/1176] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:11.546757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.558708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520f12-045d-4f38-abdf-4624ab7e639d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.563242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.563885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.564159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.564426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.565260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.565559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.567915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.585627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 586/1177] 10.222.0.36 () {56 vars in 1164 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:11.591946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.601334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f785-29eb-4eca-945e-4fd711af65de admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.605770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.606389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.606703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.606978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.614508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.616261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.624695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 592/1178] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:37:11.631170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.640536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889d2d9-29f7-477c-858b-c53a9f42f35d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.645526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.646265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.646629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.646893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.656568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.658346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.674125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 18:37:11.675234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 587/1179] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:11.681315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.689677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304c430-f555-4030-b73a-00b8dd98b78c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.694671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.695285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.695562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.695834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.696546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.696845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.698371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.709682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 593/1180] 10.222.0.36 () {56 vars in 1130 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:11.715382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.724473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3219-648b-4baf-9dd1-88cd6b3fa042 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.729009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.729769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.730049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.730355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.736937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.738866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.751395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING keystone.server.flask.application [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 18:37:11.752475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 588/1181] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:11.759274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.768208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42c1a-70a7-402b-a721-5c29f11ae21b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.773437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.774066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.774349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.774656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.775440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.775747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.777539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4003e61-8134-4774-a731-5d35531f6896 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.789393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 594/1182] 10.222.0.36 () {56 vars in 1169 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:11.795609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:11.805457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309bba-2f9b-4227-9914-60092aa99f83 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:11.809907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:11.810514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:11.810829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:11.811103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:11.811915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] RBAC: Adding query filter params (role.id=1d454c4ebcdf418baa5a3094d4e4012c, scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a, user.id=047a6b4b18904ee08f9c348948c1e795) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:11.812221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:11.814004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817232f-c5a5-4687-b3cf-c5aacf23ed2f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:11.820032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 589/1183] 10.222.0.36 () {56 vars in 1395 bytes} [Mon Oct 18 18:37:11 2021] GET /identity/v3/role_assignments?user.id=047a6b4b18904ee08f9c348948c1e795&scope.project.id=7f8522db1b9b414ba3ce0a28f49e707a&role.id=1d454c4ebcdf418baa5a3094d4e4012c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:14.059046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c1bc-eafb-4434-81e3-cd8a43f949df None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:14.059526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c1bc-eafb-4434-81e3-cd8a43f949df None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:14.059619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c1bc-eafb-4434-81e3-cd8a43f949df None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:14.061350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 595/1184] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:14.067698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:14.068098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:14.068267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:14.085581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:14.086788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:14.094263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 590/1185] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:14.116820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c1bc-eafb-4434-81e3-cd8a43f949df None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:14.129017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c1bc-eafb-4434-81e3-cd8a43f949df None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:14.133505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:14.134249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:14.134523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:14.134820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:14.135471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:14.137031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:14.148031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 18:37:14.149099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 596/1186] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:37:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:14.155271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:14.163859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50947a-788b-4b66-898c-49a6b3e093c4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:14.171109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:14.171745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:14.172019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:14.172285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:14.172989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] RBAC: Adding query filter params (name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:14.173285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:14.174885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1975d6-f601-4277-870d-0204bfd1e8ed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:14.180110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 591/1187] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Oct 18 18:37:14 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:14.186124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:14.196005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbaead-402a-45f8-b57f-89bc61784210 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:14.200435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:14.201065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:14.201343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:14.201615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] PATH_INFO: `/v3/services` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:14.202322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:14.202648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:14.204239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e718fc5-edcc-4769-beab-9e0bc56d82a3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:14.208582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 597/1188] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Oct 18 18:37:14 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:37:16.440613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962811-c561-4882-85ed-3f467942f1dc None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:16.441178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962811-c561-4882-85ed-3f467942f1dc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:16.441178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962811-c561-4882-85ed-3f467942f1dc None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:16.442959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 592/1189] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:16.448848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220357d-6045-4eec-97bc-767e18101da3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:16.449249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220357d-6045-4eec-97bc-767e18101da3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:16.449389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220357d-6045-4eec-97bc-767e18101da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:16.467050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3220357d-6045-4eec-97bc-767e18101da3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:16.468220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3220357d-6045-4eec-97bc-767e18101da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:16.476350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 598/1190] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:37:16.512006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa962811-c561-4882-85ed-3f467942f1dc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:16.529516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa962811-c561-4882-85ed-3f467942f1dc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:16.536344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:16.537140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:16.537530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:16.537921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:16.538970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:16.541145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28875207-6f5f-4fac-93ad-10c5c35ae445 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:16.555133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 593/1191] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 18 18:37:16 2021] POST /identity/v3/services => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:37:18.800970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698366f-f3cb-4695-ba2e-b28314e053b6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.801538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698366f-f3cb-4695-ba2e-b28314e053b6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.801538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698366f-f3cb-4695-ba2e-b28314e053b6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.803308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 599/1192] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:18.809242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.809645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.809783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.827511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:18.828676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:18.844528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 594/1193] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:37:18.868333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698366f-f3cb-4695-ba2e-b28314e053b6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:18.880622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698366f-f3cb-4695-ba2e-b28314e053b6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:18.885180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:18.885942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.886220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.886492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] PATH_INFO: `/v3/services/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.887187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:18.888750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:18.899290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 18:37:18.900369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 600/1194] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:37:18 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:18.906552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:18.915145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25302ed-9944-405c-82fd-6f1f34bec077 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:18.919559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:18.920186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.920460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.920725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.921433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:18.921734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:18.923344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:18.928770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 595/1195] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Oct 18 18:37:18 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:18.934820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:18.944366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f231f0-9172-4ba7-b04e-e8139255dfbe admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:18.948729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:18.949324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.949600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.949867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.950680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] RBAC: Adding query filter params (interface=public, service_id=90d48d44606e41ab8b4617a7987082e4, region_id=RegionOne) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:18.950984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:18.952494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da76c-9515-4cfb-8a43-9381ea14b10d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:18.957193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 601/1196] 10.222.0.36 () {56 vars in 1272 bytes} [Mon Oct 18 18:37:18 2021] GET /identity/v3/endpoints?service_id=90d48d44606e41ab8b4617a7987082e4&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:18.962811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:18.971717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd47ca-3a93-4403-be03-bbbf3e5dea41 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:18.976125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:18.976738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:18.977017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:18.977281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:18.977952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:18.979553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682e2f9-8df7-4f21-8c08-914399a9f0ae admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:18.986108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 596/1197] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:37:18 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:37:21.205925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543399-f123-44d7-9a8f-ceb0ca091665 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:21.207007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543399-f123-44d7-9a8f-ceb0ca091665 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:21.207107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543399-f123-44d7-9a8f-ceb0ca091665 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:21.208808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 602/1198] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:37:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:37:21.214617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:21.215072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:21.215174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:21.232667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:37:21.233841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:37:21.241488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 597/1199] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:37:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:37:21.265226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543399-f123-44d7-9a8f-ceb0ca091665 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:21.277535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543399-f123-44d7-9a8f-ceb0ca091665 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:21.281871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:21.282650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:21.282950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:21.283221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:21.283877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:21.286041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:21.296627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING keystone.server.flask.application [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 18:37:21.297719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 603/1200] 10.222.0.36 () {56 vars in 1138 bytes} [Mon Oct 18 18:37:21 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 18:37:21.303749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:21.312268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d606-3874-44e9-b2ba-ee5d28ab17ff None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:21.317257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:21.317896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:21.318171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:21.318438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] PATH_INFO: `/v3/services` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:21.319181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:37:21.319482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:21.321065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516ce31-48ac-4f4f-9603-f2df49997d15 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:21.326057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 598/1201] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Oct 18 18:37:21 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:37:21.332721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:37:21.342437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713fee8-df09-4407-a774-b9c93c8fa6b1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:37:21.346915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:37:21.347552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:37:21.347834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:37:21.348109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:37:21.348854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:37:21.350411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c28c3-f64f-4f8f-b6fb-9c463f0612f4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:37:21.367651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 604/1202] 10.222.0.36 () {60 vars in 1165 bytes} [Mon Oct 18 18:37:21 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:38:24.381835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:24.382658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:24.382658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:24.385909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 599/1203] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:24.390710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf30a2-5625-41b0-8006-96f0dd8bb088 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:24.391130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf30a2-5625-41b0-8006-96f0dd8bb088 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:24.391337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf30a2-5625-41b0-8006-96f0dd8bb088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:24.494982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e6cf30a2-5625-41b0-8006-96f0dd8bb088 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:24.496496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e6cf30a2-5625-41b0-8006-96f0dd8bb088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:24.629605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 605/1204] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:24.655144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:24.657136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:24.795726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fb87a-f3da-4eb1-885a-6ec76775b20e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:24.889016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:24.889844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:24.890231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:24.890643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:24.891487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:24.893481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3118d7-b405-4d1d-b53a-0a1905dadd3c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:24.914463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 600/1205] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:38:24 2021] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:38:27.186961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f703-640f-43f4-9b9a-33f9c9888897 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:27.187518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f703-640f-43f4-9b9a-33f9c9888897 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:27.187518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f703-640f-43f4-9b9a-33f9c9888897 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:27.189840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 606/1206] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:27.195708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38736e8-e650-449a-b975-b2f642c05926 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:27.196121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38736e8-e650-449a-b975-b2f642c05926 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:27.196251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38736e8-e650-449a-b975-b2f642c05926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:27.265193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a38736e8-e650-449a-b975-b2f642c05926 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:27.266314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a38736e8-e650-449a-b975-b2f642c05926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:27.358751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 601/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:27.411072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:27.411384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:27.411664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:27.413445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 607/1208] 10.222.0.36 () {54 vars in 963 bytes} [Mon Oct 18 18:38:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:27.419599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862c2a-fed5-40da-8c1c-538a1d50d8bd None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:27.419885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862c2a-fed5-40da-8c1c-538a1d50d8bd None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:27.420169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862c2a-fed5-40da-8c1c-538a1d50d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:27.498284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9f862c2a-fed5-40da-8c1c-538a1d50d8bd None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:27.499547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9f862c2a-fed5-40da-8c1c-538a1d50d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:27.576704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 602/1209] 10.222.0.36 () {58 vars in 1060 bytes} [Mon Oct 18 18:38:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:38:27.586915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:27.588509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:27.691165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeb422-0168-45c7-b2b3-dfbdb409b81e None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:27.759638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:27.760276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:27.760558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:27.760830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:27.762453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:27.864062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:27.865384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26f444-5872-4f9d-bb43-2b33dd6b2d9a service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:27.883742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 608/1210] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:38:30.401635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c931-241d-4345-8640-868beb4a96da None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:30.402195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c931-241d-4345-8640-868beb4a96da None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:30.402195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c931-241d-4345-8640-868beb4a96da None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:30.403991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 603/1211] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:30.410109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11276e-35e8-4a77-972d-acccc29a589a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:30.410513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11276e-35e8-4a77-972d-acccc29a589a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:30.410698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11276e-35e8-4a77-972d-acccc29a589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:30.471720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0e11276e-35e8-4a77-972d-acccc29a589a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:30.472914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0e11276e-35e8-4a77-972d-acccc29a589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:30.562394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 609/1212] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:30.617895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:30.618176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:30.618450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:30.620234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 604/1213] 10.222.0.36 () {54 vars in 963 bytes} [Mon Oct 18 18:38:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:30.626146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f325b-1bb4-4061-bbec-f72253c7e757 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:30.626429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f325b-1bb4-4061-bbec-f72253c7e757 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:30.626734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f325b-1bb4-4061-bbec-f72253c7e757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:30.698619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ac6f325b-1bb4-4061-bbec-f72253c7e757 None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:30.699791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ac6f325b-1bb4-4061-bbec-f72253c7e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:30.772173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 610/1214] 10.222.0.36 () {58 vars in 1060 bytes} [Mon Oct 18 18:38:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:38:30.781372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:30.782967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:30.880876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4a748-3b96-4771-abef-8927b410074b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:30.949872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:30.950441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:30.950751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:30.951023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:30.952636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:31.056143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:31.057559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819d00b-11a7-4f85-85e9-2fffcbddd3bb service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:31.074353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 605/1215] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:33.857297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:33.857935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:33.857935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:33.859644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 611/1216] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:33.866206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:33.866742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:33.866838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:33.928859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:33.930059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:34.020808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 606/1217] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:34.057499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:34.059044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:34.176176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5b0a-bf6a-4040-8064-9e223594e9f4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:34.263297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:34.264140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:34.264417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:34.264690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:34.274494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:34.276572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9b773-60f0-44c7-920c-70d9b040ef5d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:34.278248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 612/1218] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:38:34 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:38:34.292138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:34.293323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:34.377156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657949-d089-4a43-89e5-a63de21a7193 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:34.445630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:34.446196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:34.446476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:34.446776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:34.453099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:34.562389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:34.564367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429fbd-1e51-42be-8ecb-8e7a9d96237a service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:34.582063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 607/1219] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:37.306942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:37.307485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:37.307485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:37.309249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 613/1220] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:37.315636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:37.316071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:37.316175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:37.377802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:37.379019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:37.467211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 608/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:37.508210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:37.509758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:37.627397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ce98-2292-4bb0-8100-c5e613dfd88f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:37.714246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:37.715106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:37.715380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:37.715646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:37.724726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:37.726783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ca643-b0c4-4b4a-b26b-6c0186152bd4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:37.728422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 614/1222] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:38:37 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:38:37.740789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:37.741976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:37.846949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4332b4-ba1b-455f-9199-80957729926a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:37.915056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:37.915627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:37.915904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:37.916175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:37.917795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:38.020407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:38.021843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8eed4-88c8-4855-b260-74d2078c9f62 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:38.039009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 609/1223] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:40.915043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:40.915637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:40.915637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:40.917371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 615/1224] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:40.924549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789e20-1bb7-4dc9-b4d4-2304336054e6 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:40.925096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789e20-1bb7-4dc9-b4d4-2304336054e6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:40.925206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789e20-1bb7-4dc9-b4d4-2304336054e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:40.991419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-88789e20-1bb7-4dc9-b4d4-2304336054e6 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:40.992871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-88789e20-1bb7-4dc9-b4d4-2304336054e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:41.090322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 610/1225] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:41.127622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:41.129143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:41.225424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6706d1-a11f-4d7a-92c5-b772a621bce6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:41.294385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:41.295057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:41.295331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:41.295598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:41.297196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:41.397976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:41.399434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd782c5-482e-41ee-abfd-89bcfefc6eb9 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:41.416947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 616/1226] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:43.709886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:43.710411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:43.710411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:43.712114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 611/1227] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:43.718264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009cc0-ae0a-4d20-a694-f6d9e710d1b3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:43.718707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009cc0-ae0a-4d20-a694-f6d9e710d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:43.718846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff009cc0-ae0a-4d20-a694-f6d9e710d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:43.780284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ff009cc0-ae0a-4d20-a694-f6d9e710d1b3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:43.781468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ff009cc0-ae0a-4d20-a694-f6d9e710d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:43.872859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 617/1228] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:43.914979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:43.916546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:44.017837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672f3d5-cdbd-4845-8fdd-2cb76405e517 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:44.087169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:44.087811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:44.088089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:44.088363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:44.090019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:44.197390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:44.198843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28a791-e37d-4707-90b2-ef6cbd8ecd57 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:44.215917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 612/1229] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:46.510681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:46.511249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:46.511249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:46.513006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 618/1230] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:46.519500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:46.519929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:46.520064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:46.582177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:46.583396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:46.686364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 613/1231] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:46.720554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:46.722082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:46.839713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd27f00-9267-46dc-919d-7fbf4b934617 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:46.941365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:46.942211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:46.942484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:46.942780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:46.952115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:46.954688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1131271-fae1-45f6-a0be-be41ebb33b95 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:46.956533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 619/1232] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:38:46 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:38:46.968388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:46.970272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:47.058478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a295-5bac-44f8-a7c0-5452d0117293 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:47.128676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:47.129232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:47.129504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:47.129769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:47.131409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:47.237153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:47.238626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980b244-094a-41ca-9f47-0eb1d060f28a service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:47.256451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 614/1233] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:49.931218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:49.931784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:49.931784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:49.933538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 620/1234] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:49.939897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431265-feab-4161-841e-e7488ad84947 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:49.940325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431265-feab-4161-841e-e7488ad84947 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:49.940446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431265-feab-4161-841e-e7488ad84947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:50.015113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d7431265-feab-4161-841e-e7488ad84947 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:50.016967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d7431265-feab-4161-841e-e7488ad84947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:50.119644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 615/1235] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:50.161916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:50.163582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:50.263833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8fba-802a-438b-b45c-65543af852d1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:50.333047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:50.333688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:50.333969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:50.334250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:50.335901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:50.436930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:50.438909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2e69e-c957-4751-949a-4807e8bfdb6f service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:50.456368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 621/1236] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:52.742317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:52.742928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:52.742928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:52.744654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 616/1237] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:52.751206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a713fa-3676-451f-81e6-da6fb3bcc958 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:52.751631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a713fa-3676-451f-81e6-da6fb3bcc958 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:52.751748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a713fa-3676-451f-81e6-da6fb3bcc958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:52.815148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-63a713fa-3676-451f-81e6-da6fb3bcc958 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:52.816365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-63a713fa-3676-451f-81e6-da6fb3bcc958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:52.906389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 622/1238] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:52.948799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:52.950469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:53.054233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facddb-7c38-44e8-8c1b-e1ad31246c32 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:53.123293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:53.123930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:53.124206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:53.124476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:53.126684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:53.227700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:53.229116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afae3ff-94da-4646-9cf3-f330392788f6 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:53.246131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 617/1239] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:38:55.800207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:55.800772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:55.800772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:55.802503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 623/1240] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:38:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:38:55.808284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b630-89fb-4544-b92c-a73d66bcf62c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:55.808671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b630-89fb-4544-b92c-a73d66bcf62c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:55.808832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b630-89fb-4544-b92c-a73d66bcf62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:55.876591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-f058b630-89fb-4544-b92c-a73d66bcf62c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:38:55.877781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f058b630-89fb-4544-b92c-a73d66bcf62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:55.976875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 618/1241] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:38:56.020461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:38:56.022606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:38:56.109833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd50a6-e491-4ccd-a90e-20a27e5e8a1d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:38:56.113787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:38:56.114412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:38:56.114718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:38:56.114993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:38:56.123439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:38:56.124843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ac516-cca4-4dd0-a931-20eca36133c6 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:38:56.134027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 624/1242] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:38:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:00.315158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f989-78a5-4258-8e53-e2aee6d56acd None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:00.315709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f989-78a5-4258-8e53-e2aee6d56acd None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:00.315709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f989-78a5-4258-8e53-e2aee6d56acd None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:00.317456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 619/1243] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:00.323680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a992-1d03-4a38-8af8-10705dfb59a0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:00.324131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a992-1d03-4a38-8af8-10705dfb59a0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:00.324378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a992-1d03-4a38-8af8-10705dfb59a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:00.342366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8f44a992-1d03-4a38-8af8-10705dfb59a0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:00.343570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8f44a992-1d03-4a38-8af8-10705dfb59a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:00.351277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 625/1244] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:00.393007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f989-78a5-4258-8e53-e2aee6d56acd None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:00.403695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f989-78a5-4258-8e53-e2aee6d56acd None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:00.407170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:00.407802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:00.408083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:00.408352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:00.416912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:00.418341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e230-a04c-45e8-afa2-cf661101c864 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:00.427905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 620/1245] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:03.261237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37fa7-317f-4e5d-9327-5885bd8d47f7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:03.261762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37fa7-317f-4e5d-9327-5885bd8d47f7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:03.261762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37fa7-317f-4e5d-9327-5885bd8d47f7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:03.263512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 626/1246] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:03.269437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8828-7b67-4ef7-ac23-482da9664f33 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:03.269873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8828-7b67-4ef7-ac23-482da9664f33 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:03.270010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8828-7b67-4ef7-ac23-482da9664f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:03.288025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-393a8828-7b67-4ef7-ac23-482da9664f33 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:03.289203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-393a8828-7b67-4ef7-ac23-482da9664f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:03.298375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 621/1247] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:03.339577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37fa7-317f-4e5d-9327-5885bd8d47f7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:03.349865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37fa7-317f-4e5d-9327-5885bd8d47f7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:03.353394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:03.354111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:03.354458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:03.354828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:03.364032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:03.365445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cfb13-9e5e-4253-9736-61ac76a12a05 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:03.374632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 627/1248] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:07.680569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7289be-d554-4b39-8ecf-2565113fc3af None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:07.681161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7289be-d554-4b39-8ecf-2565113fc3af None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:07.681161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7289be-d554-4b39-8ecf-2565113fc3af None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:07.682933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 622/1249] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:07.689751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2b97-b758-431e-b937-f67e522359f0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:07.690260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2b97-b758-431e-b937-f67e522359f0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:07.690370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2b97-b758-431e-b937-f67e522359f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:07.707984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5e2d2b97-b758-431e-b937-f67e522359f0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:07.709178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5e2d2b97-b758-431e-b937-f67e522359f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:07.717184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 628/1250] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:07.757855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7289be-d554-4b39-8ecf-2565113fc3af None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:07.769026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7289be-d554-4b39-8ecf-2565113fc3af None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:07.772527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:07.773157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:07.773434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:07.773705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:07.782663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:07.784052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b773b41-a15a-43ce-b30e-c170b450b57e service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:07.795003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 623/1251] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:12.968846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc34c-8b9b-41e5-bfeb-b9f50c02827a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:12.969361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc34c-8b9b-41e5-bfeb-b9f50c02827a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:12.969471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc34c-8b9b-41e5-bfeb-b9f50c02827a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:12.971568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 629/1252] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:39:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:12.980692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c850-c1a2-409e-8d59-fb3699aac528 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:12.981502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c850-c1a2-409e-8d59-fb3699aac528 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:12.981907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c850-c1a2-409e-8d59-fb3699aac528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:13.057686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-f3c3c850-c1a2-409e-8d59-fb3699aac528 None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:13.059530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f3c3c850-c1a2-409e-8d59-fb3699aac528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:13.140033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 624/1253] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:39:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:17.290450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176861e-7ebe-4819-9597-79d09e29540e None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:17.291320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176861e-7ebe-4819-9597-79d09e29540e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:17.291600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176861e-7ebe-4819-9597-79d09e29540e None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:17.293364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 630/1254] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:39:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:17.299304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94ec4-73d2-43f4-9ff2-eedd11d63ed7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:17.299717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94ec4-73d2-43f4-9ff2-eedd11d63ed7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:17.300041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94ec4-73d2-43f4-9ff2-eedd11d63ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:17.319571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7eb94ec4-73d2-43f4-9ff2-eedd11d63ed7 None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:17.320757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7eb94ec4-73d2-43f4-9ff2-eedd11d63ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:17.329613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 625/1255] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:39:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:18.841362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a80e-90d8-4e3a-9224-fd26524204dc None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:18.841889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a80e-90d8-4e3a-9224-fd26524204dc None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:18.842096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a80e-90d8-4e3a-9224-fd26524204dc None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:18.844116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 631/1256] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:39:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:18.849653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45b2e-5fe9-4be0-9be6-fb6db23d587e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:18.850066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45b2e-5fe9-4be0-9be6-fb6db23d587e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:18.850337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45b2e-5fe9-4be0-9be6-fb6db23d587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:18.868611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-bab45b2e-5fe9-4be0-9be6-fb6db23d587e None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:18.869856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-bab45b2e-5fe9-4be0-9be6-fb6db23d587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:18.878777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 626/1257] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:39:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:22.742188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86973aae-2998-43b0-a8dd-ddbbf9748987 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:22.743033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86973aae-2998-43b0-a8dd-ddbbf9748987 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:22.743306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86973aae-2998-43b0-a8dd-ddbbf9748987 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:22.745338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 632/1258] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:22.751211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87168462-e0c7-4284-a1bc-3ffd5d391f5d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:22.751686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87168462-e0c7-4284-a1bc-3ffd5d391f5d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:22.751937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87168462-e0c7-4284-a1bc-3ffd5d391f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:22.769727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-87168462-e0c7-4284-a1bc-3ffd5d391f5d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:22.771026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-87168462-e0c7-4284-a1bc-3ffd5d391f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:22.778851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 627/1259] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:22.830444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e9fbb-a70f-4828-8540-56556bb8d8d8 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:22.830824 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e9fbb-a70f-4828-8540-56556bb8d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:22.831175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e9fbb-a70f-4828-8540-56556bb8d8d8 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:22.834276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 633/1260] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:39:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:22.840657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da2eb-02f4-4cab-8556-53f744c5782c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:22.840946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da2eb-02f4-4cab-8556-53f744c5782c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:22.841222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da2eb-02f4-4cab-8556-53f744c5782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:22.888757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7e9da2eb-02f4-4cab-8556-53f744c5782c None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:22.889942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7e9da2eb-02f4-4cab-8556-53f744c5782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:22.976174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 628/1261] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:39:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:22.987348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e9fbb-a70f-4828-8540-56556bb8d8d8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:23.008745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e9fbb-a70f-4828-8540-56556bb8d8d8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:23.014530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:23.015428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:23.015855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:23.016274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:23.024451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:23.026171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfe8ad-be81-4177-a01c-3ca4e348fe05 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:23.036740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 634/1262] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:39:25.553541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb75da-b5f7-4cc9-9d65-79ada0523d50 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:25.554049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb75da-b5f7-4cc9-9d65-79ada0523d50 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:25.554139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb75da-b5f7-4cc9-9d65-79ada0523d50 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:25.555879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 629/1263] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:25.561824 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645feb9-ef61-4f35-b8e2-16dbe22a24da None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:25.562285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645feb9-ef61-4f35-b8e2-16dbe22a24da None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:25.562401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645feb9-ef61-4f35-b8e2-16dbe22a24da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:25.580185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4645feb9-ef61-4f35-b8e2-16dbe22a24da None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:25.581297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4645feb9-ef61-4f35-b8e2-16dbe22a24da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:25.589374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 635/1264] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:25.635770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb75da-b5f7-4cc9-9d65-79ada0523d50 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:25.652207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb75da-b5f7-4cc9-9d65-79ada0523d50 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:25.658921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:25.660234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:25.660727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:25.661150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:25.669650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:25.671434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c67cd-7280-4e4f-99c1-260dd7b57693 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:25.681373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 630/1265] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:28.288641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21a58-a5ca-4b86-b59f-7a06d0f3ad78 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:28.289164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21a58-a5ca-4b86-b59f-7a06d0f3ad78 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:28.289164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21a58-a5ca-4b86-b59f-7a06d0f3ad78 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:28.290923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 636/1266] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:28.296958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4b548-6efc-4199-b351-a9e1cb303e3f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:28.297409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4b548-6efc-4199-b351-a9e1cb303e3f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:28.297510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4b548-6efc-4199-b351-a9e1cb303e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:28.317108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-92b4b548-6efc-4199-b351-a9e1cb303e3f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:28.319006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-92b4b548-6efc-4199-b351-a9e1cb303e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:28.329286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 631/1267] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:28.377973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274800-b0b8-4aaf-a893-312966ca9ce8 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:28.378248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274800-b0b8-4aaf-a893-312966ca9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:28.378521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274800-b0b8-4aaf-a893-312966ca9ce8 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:28.380430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 637/1268] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:39:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:28.389339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ea06-d395-4280-8fc5-e2d0f21d9e58 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:28.389630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ea06-d395-4280-8fc5-e2d0f21d9e58 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:28.389915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3ea06-d395-4280-8fc5-e2d0f21d9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:28.411579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b3b3ea06-d395-4280-8fc5-e2d0f21d9e58 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:28.412934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b3b3ea06-d395-4280-8fc5-e2d0f21d9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:28.423618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 632/1269] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:39:28 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:28.434010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274800-b0b8-4aaf-a893-312966ca9ce8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:28.448702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274800-b0b8-4aaf-a893-312966ca9ce8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:28.455331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:28.455979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:28.456257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:28.456721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:28.465744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:28.467538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181a931-705b-40f5-9dad-0d48ee505fa0 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:28.478153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 638/1270] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:39:30.580567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f8513-4f0f-471d-9d25-078561f0bb04 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.581109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f8513-4f0f-471d-9d25-078561f0bb04 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.581734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f8513-4f0f-471d-9d25-078561f0bb04 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.583802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 633/1271] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:30.589741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513226a2-9126-4a9d-b40c-b7a9c593f27c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.590178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513226a2-9126-4a9d-b40c-b7a9c593f27c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.590481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513226a2-9126-4a9d-b40c-b7a9c593f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.608433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-513226a2-9126-4a9d-b40c-b7a9c593f27c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:30.610378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-513226a2-9126-4a9d-b40c-b7a9c593f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:30.618390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 639/1272] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:30.674177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d12b-f41a-4e48-9754-36522bbb59a3 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.674456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d12b-f41a-4e48-9754-36522bbb59a3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.674949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d12b-f41a-4e48-9754-36522bbb59a3 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.676878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 634/1273] 10.222.0.36 () {54 vars in 962 bytes} [Mon Oct 18 18:39:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:30.682420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473160c-2206-49bf-a6a7-7b63f63e5034 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.682966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473160c-2206-49bf-a6a7-7b63f63e5034 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.683399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473160c-2206-49bf-a6a7-7b63f63e5034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.742029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2473160c-2206-49bf-a6a7-7b63f63e5034 None None] MFA Rules not processed for user `c48e090bca024c92a9cf7c038d225777`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:30.743582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2473160c-2206-49bf-a6a7-7b63f63e5034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:30.808622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 640/1274] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Oct 18 18:39:30 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:30.816784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d12b-f41a-4e48-9754-36522bbb59a3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:30.827443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d12b-f41a-4e48-9754-36522bbb59a3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:30.831262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:30.832071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.832503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.832926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.842085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:30.844319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:30.845513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5b00-38b7-480b-881f-d4180fadeda6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.845801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5b00-38b7-480b-881f-d4180fadeda6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.846075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5b00-38b7-480b-881f-d4180fadeda6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.848022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 641/1275] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:39:30.853581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfc51-4211-4ad6-88f8-eb67cc29f95e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.853864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfc51-4211-4ad6-88f8-eb67cc29f95e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.854293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfc51-4211-4ad6-88f8-eb67cc29f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.854402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 635/1276] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:30.873937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-141bfc51-4211-4ad6-88f8-eb67cc29f95e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:30.875365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-141bfc51-4211-4ad6-88f8-eb67cc29f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:30.896469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 642/1277] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:39:30.943267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:30.955783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be50b-d010-445d-be51-32ee65bc515f service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:30.961496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:30.962125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:30.962407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:30.962723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:30.971585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:30.973220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961a27c-b3ed-4c04-9b78-fe9a0af3522d service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:30.984780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 636/1278] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:33.306856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1578e-9ba4-4a25-a5a9-d0e4f33d3b11 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:33.307367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1578e-9ba4-4a25-a5a9-d0e4f33d3b11 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:33.307455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1578e-9ba4-4a25-a5a9-d0e4f33d3b11 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:33.309170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 643/1279] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:33.315827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449c41-f78f-4d7c-8c22-be436c6a4495 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:33.316280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449c41-f78f-4d7c-8c22-be436c6a4495 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:33.316441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93449c41-f78f-4d7c-8c22-be436c6a4495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:33.334188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-93449c41-f78f-4d7c-8c22-be436c6a4495 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:33.335382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-93449c41-f78f-4d7c-8c22-be436c6a4495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:33.343051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 637/1280] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:33.390084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1578e-9ba4-4a25-a5a9-d0e4f33d3b11 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:33.404817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1578e-9ba4-4a25-a5a9-d0e4f33d3b11 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:33.411217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73060071-6201-4763-9fba-87169c42c143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:33.411854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73060071-6201-4763-9fba-87169c42c143 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:33.412133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73060071-6201-4763-9fba-87169c42c143 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:33.412409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73060071-6201-4763-9fba-87169c42c143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:33.420764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73060071-6201-4763-9fba-87169c42c143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:33.422536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73060071-6201-4763-9fba-87169c42c143 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:33.431733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 644/1281] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:35.757680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2398f-8c83-4354-b281-dcbffb982d7a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:35.758258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2398f-8c83-4354-b281-dcbffb982d7a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:35.758258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2398f-8c83-4354-b281-dcbffb982d7a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:35.760183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 638/1282] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:35.766462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f616b6-d8d4-4302-aa6c-3f9ffe538a97 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:35.766940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f616b6-d8d4-4302-aa6c-3f9ffe538a97 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:35.767039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f616b6-d8d4-4302-aa6c-3f9ffe538a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:35.784852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-95f616b6-d8d4-4302-aa6c-3f9ffe538a97 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:35.786028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-95f616b6-d8d4-4302-aa6c-3f9ffe538a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:35.793987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 645/1283] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:35.840129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2398f-8c83-4354-b281-dcbffb982d7a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:35.855120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2398f-8c83-4354-b281-dcbffb982d7a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:35.860576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:35.861207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:35.861487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:35.861763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:35.869878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:35.871484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f8030-07d8-440c-b591-a519b1eead92 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:35.881657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 639/1284] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:38.237717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c83d-10cd-4707-9229-398cac815b2b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:38.238252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c83d-10cd-4707-9229-398cac815b2b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:38.238437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c83d-10cd-4707-9229-398cac815b2b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:38.240782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 646/1285] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:38.247300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d840c0f-4108-49ae-965c-8a54d35257a4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:38.247781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d840c0f-4108-49ae-965c-8a54d35257a4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:38.248001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d840c0f-4108-49ae-965c-8a54d35257a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:38.270826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1d840c0f-4108-49ae-965c-8a54d35257a4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:38.272330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1d840c0f-4108-49ae-965c-8a54d35257a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:38.282553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 640/1286] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:38.326378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c83d-10cd-4707-9229-398cac815b2b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:38.344401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c83d-10cd-4707-9229-398cac815b2b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:38.351645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:38.352430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:38.353045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:38.353399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:38.363365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:38.364949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72d181-8371-410f-8ee1-ac264d59a412 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:38.374283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 647/1287] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:40.662320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2104-08cc-45df-a78d-9d3c2314abfc None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:40.663244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2104-08cc-45df-a78d-9d3c2314abfc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:40.663244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2104-08cc-45df-a78d-9d3c2314abfc None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:40.664623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 641/1288] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:40.671981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ab586-bd67-4818-af96-bb7556867de8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:40.672536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ab586-bd67-4818-af96-bb7556867de8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:40.672536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ab586-bd67-4818-af96-bb7556867de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:40.690875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ec4ab586-bd67-4818-af96-bb7556867de8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:40.692080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ec4ab586-bd67-4818-af96-bb7556867de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:40.699821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 648/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:40.747782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2104-08cc-45df-a78d-9d3c2314abfc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:40.763858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2104-08cc-45df-a78d-9d3c2314abfc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:40.769933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:40.770588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:40.770869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:40.771139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:40.779604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:40.781199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b0909-6cab-4e58-b0af-94be9b1a6b01 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:40.790632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 642/1290] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:43.085739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad49ef-05f0-41db-a588-691c23675aa1 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:43.086268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad49ef-05f0-41db-a588-691c23675aa1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:43.086397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad49ef-05f0-41db-a588-691c23675aa1 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:43.088132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 649/1291] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:43.094189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3b09-a6e1-4386-9bf5-3496d1194419 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:43.094630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3b09-a6e1-4386-9bf5-3496d1194419 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:43.094770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3b09-a6e1-4386-9bf5-3496d1194419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:43.112641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ecab3b09-a6e1-4386-9bf5-3496d1194419 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:43.113833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ecab3b09-a6e1-4386-9bf5-3496d1194419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:43.121738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 643/1292] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:43.170476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad49ef-05f0-41db-a588-691c23675aa1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:43.185945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad49ef-05f0-41db-a588-691c23675aa1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:43.192434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:43.193070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:43.193387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:43.193732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:43.202842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:43.204511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c60cd-f31f-4711-a609-c21a76bb0dc4 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:43.214566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 650/1293] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:45.550161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de82d0-05b6-4571-b70b-b697635112c6 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:45.550861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de82d0-05b6-4571-b70b-b697635112c6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:45.550861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de82d0-05b6-4571-b70b-b697635112c6 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:45.552508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 644/1294] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:45.558780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2344a-9b3f-412c-9ffa-96080e1d1e81 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:45.559276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2344a-9b3f-412c-9ffa-96080e1d1e81 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:45.559381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2344a-9b3f-412c-9ffa-96080e1d1e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:45.576707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9fd2344a-9b3f-412c-9ffa-96080e1d1e81 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:45.578463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9fd2344a-9b3f-412c-9ffa-96080e1d1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:45.586152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 651/1295] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:45.634446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de82d0-05b6-4571-b70b-b697635112c6 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:45.648939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de82d0-05b6-4571-b70b-b697635112c6 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:45.654233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:45.654895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:45.655174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:45.656024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:45.664020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:45.665605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311510-05ef-40a8-9a49-b1e4c4c41f0e service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:45.674931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 645/1296] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:46.271560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321e4a7-1879-4087-aef0-056ac50b88c5 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:46.271772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321e4a7-1879-4087-aef0-056ac50b88c5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:46.272021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321e4a7-1879-4087-aef0-056ac50b88c5 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:46.273876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 652/1297] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:46.280318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87007-c98e-4b2f-8752-8cf960928c89 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:46.280992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87007-c98e-4b2f-8752-8cf960928c89 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:46.280992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87007-c98e-4b2f-8752-8cf960928c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:46.303773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5ed87007-c98e-4b2f-8752-8cf960928c89 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:46.305047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5ed87007-c98e-4b2f-8752-8cf960928c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:46.313869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 646/1298] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:39:46.375157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb81a-6233-45b7-9b71-c552ad3449ee None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:46.375534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb81a-6233-45b7-9b71-c552ad3449ee None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:46.375881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb81a-6233-45b7-9b71-c552ad3449ee None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:46.377797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 653/1299] 10.222.0.36 () {54 vars in 962 bytes} [Mon Oct 18 18:39:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:46.383985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c193d-857d-42de-b7a2-969f01467cd3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:46.384326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c193d-857d-42de-b7a2-969f01467cd3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:46.384626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c193d-857d-42de-b7a2-969f01467cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:46.435418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2d8c193d-857d-42de-b7a2-969f01467cd3 None None] MFA Rules not processed for user `d34f3e4c4a4244128b8d4d1ba548d270`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:46.437550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2d8c193d-857d-42de-b7a2-969f01467cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:46.504685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 647/1300] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Oct 18 18:39:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:46.513676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cb81a-6233-45b7-9b71-c552ad3449ee None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:46.525624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cb81a-6233-45b7-9b71-c552ad3449ee None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:46.529517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:46.530236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:46.531117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:46.531449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:46.541657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:46.543365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a388f-7a5f-486b-b03a-fe930f03e565 service glance] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:46.555311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 654/1301] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:47.042869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28520e-ee66-44a0-8727-3b9ca5a3a55e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:47.043381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28520e-ee66-44a0-8727-3b9ca5a3a55e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:47.043635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28520e-ee66-44a0-8727-3b9ca5a3a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:47.097390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7b28520e-ee66-44a0-8727-3b9ca5a3a55e None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:47.098537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7b28520e-ee66-44a0-8727-3b9ca5a3a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:47.165838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 648/1302] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:39:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:47.211913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428034b-6962-4641-a600-b7322c3e4407 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:47.212422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428034b-6962-4641-a600-b7322c3e4407 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:47.212500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428034b-6962-4641-a600-b7322c3e4407 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:47.214271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 655/1303] 10.222.0.36 () {54 vars in 942 bytes} [Mon Oct 18 18:39:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:47.221932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f0fb-bc33-4d22-a5e4-24081eda2585 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:47.222270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f0fb-bc33-4d22-a5e4-24081eda2585 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:47.222656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2f0fb-bc33-4d22-a5e4-24081eda2585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:47.274234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-67b2f0fb-bc33-4d22-a5e4-24081eda2585 None None] MFA Rules not processed for user `b43005d7c7ec4c14bd0708164c20fe53`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:47.275539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-67b2f0fb-bc33-4d22-a5e4-24081eda2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:47.345497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 649/1304] 10.222.0.36 () {58 vars in 1039 bytes} [Mon Oct 18 18:39:47 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:47.355466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428034b-6962-4641-a600-b7322c3e4407 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:47.369887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428034b-6962-4641-a600-b7322c3e4407 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:47.375069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:47.375711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:47.375994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:47.376422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:47.384825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:47.386420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282e062-b8f2-42b9-a66a-47d0052f854e service swift] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:47.397021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 656/1305] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:39:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:39:47.991616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279406-c827-49cd-b72e-7f3ca8006902 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:47.991900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279406-c827-49cd-b72e-7f3ca8006902 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:47.992190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279406-c827-49cd-b72e-7f3ca8006902 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:47.994226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 650/1306] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:48.001089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11efde-0315-4b8a-a8dc-f1954b4aedbd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:48.001377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11efde-0315-4b8a-a8dc-f1954b4aedbd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:48.001654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11efde-0315-4b8a-a8dc-f1954b4aedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:48.020216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-af11efde-0315-4b8a-a8dc-f1954b4aedbd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:48.021509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-af11efde-0315-4b8a-a8dc-f1954b4aedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:48.029740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 657/1307] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:39:48.079213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279406-c827-49cd-b72e-7f3ca8006902 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:48.094805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279406-c827-49cd-b72e-7f3ca8006902 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:48.100430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:48.101274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:48.101626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:48.101900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:48.111507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:48.113221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce611a-6c7d-4a22-a2cd-93bc04cb18e3 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:48.123716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 651/1308] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:39:50.447395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd627e-49a5-4d59-914b-4ef24f4b95b7 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:50.447960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd627e-49a5-4d59-914b-4ef24f4b95b7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:50.447960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd627e-49a5-4d59-914b-4ef24f4b95b7 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:50.449693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 658/1309] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:39:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:39:50.455758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc837bf-1e5f-4554-8030-360c1f5c1282 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:50.456201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc837bf-1e5f-4554-8030-360c1f5c1282 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:50.456300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc837bf-1e5f-4554-8030-360c1f5c1282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:50.474835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-edc837bf-1e5f-4554-8030-360c1f5c1282 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:39:50.476324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-edc837bf-1e5f-4554-8030-360c1f5c1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:39:50.485778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 652/1310] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:39:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:39:50.539745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd627e-49a5-4d59-914b-4ef24f4b95b7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:39:50.570760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd627e-49a5-4d59-914b-4ef24f4b95b7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:39:50.582926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:39:50.583751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:39:50.584036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:39:50.584359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:39:50.611877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:39:50.613793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af9d1-c8a3-4f9c-aa31-423740d697bd service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:39:50.644840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 659/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:39:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:05.477057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229805f-f35b-42e8-9fca-0dae3451122c None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:05.477593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229805f-f35b-42e8-9fca-0dae3451122c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:05.477593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229805f-f35b-42e8-9fca-0dae3451122c None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:05.479382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 653/1312] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:05.485769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764caa32-25e2-4d32-a0a7-99fdc726228a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:05.486209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764caa32-25e2-4d32-a0a7-99fdc726228a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:05.486352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764caa32-25e2-4d32-a0a7-99fdc726228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:05.503854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-764caa32-25e2-4d32-a0a7-99fdc726228a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:05.505040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-764caa32-25e2-4d32-a0a7-99fdc726228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:05.512870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 660/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:05.537152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229805f-f35b-42e8-9fca-0dae3451122c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:05.549643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229805f-f35b-42e8-9fca-0dae3451122c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:05.553967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:05.554648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:05.554924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:05.555192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:05.555917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:05.557737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7012-247b-4726-90cb-1dd33e3214b2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:05.570689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 654/1314] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:40:05 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:40:07.757524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7119-fb38-4f75-9288-86c223ac8495 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:07.758104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7119-fb38-4f75-9288-86c223ac8495 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:07.758104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7119-fb38-4f75-9288-86c223ac8495 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:07.759847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 661/1315] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:07.766243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:07.766702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:07.766840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:07.784038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:07.785220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:07.792841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 655/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:07.816602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7119-fb38-4f75-9288-86c223ac8495 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:07.829103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7119-fb38-4f75-9288-86c223ac8495 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:07.833408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:07.834218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:07.834490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:07.834788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] PATH_INFO: `/v3/projects/0023ad842dbd4c2798ddbea86a7268fd` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:07.845191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] RBAC: Authorizing `identity:get_project(project_id=0023ad842dbd4c2798ddbea86a7268fd)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:07.847252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:07.848945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 662/1317] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:07 2021] GET /identity/v3/projects/0023ad842dbd4c2798ddbea86a7268fd => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:07.855474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:07.864596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6389-30ac-4dc0-bfac-781774f0f850 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:07.869031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:07.869651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:07.869924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:07.870190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:07.870988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] RBAC: Adding query filter params (scope.project.id=0023ad842dbd4c2798ddbea86a7268fd) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:07.871287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:07.873099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a184-1b69-47ac-8c0a-c0ea523cb177 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:07.880654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 656/1318] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:07 2021] GET /identity/v3/role_assignments?scope.project.id=0023ad842dbd4c2798ddbea86a7268fd => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:07.887277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:07.896522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4992-9d9e-4d6f-8f9b-c89bb9bb5175 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:07.900867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:07.901705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:07.901973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:07.902240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:07.915642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:07.917734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787f2f6-5080-4f90-95dd-fff6bf315590 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:07.919334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 663/1319] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:07 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:10.159178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4fa2-6039-47b2-ad93-060f7afcfdcf None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.159686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4fa2-6039-47b2-ad93-060f7afcfdcf None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.159796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4fa2-6039-47b2-ad93-060f7afcfdcf None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.161537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 657/1320] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:10.167646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.168052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.168198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.185320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:10.186500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:10.194065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 664/1321] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:10.218267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4fa2-6039-47b2-ad93-060f7afcfdcf None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:10.230355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4fa2-6039-47b2-ad93-060f7afcfdcf None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:10.234821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:10.235639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.235916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.236186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] PATH_INFO: `/v3/projects/4179a663c0e248e299c331187a356f37` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.246807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] RBAC: Authorizing `identity:get_project(project_id=4179a663c0e248e299c331187a356f37)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:10.248819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:10.250438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 658/1322] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:10 2021] GET /identity/v3/projects/4179a663c0e248e299c331187a356f37 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:10.257031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:10.266204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b49bc-dbde-4f13-8bdd-1d4abfb4ee3e None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:10.270678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:10.271307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.271586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.271863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.272631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] RBAC: Adding query filter params (scope.project.id=4179a663c0e248e299c331187a356f37) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:10.272935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:10.274768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:10.282608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 665/1323] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:10 2021] GET /identity/v3/role_assignments?scope.project.id=4179a663c0e248e299c331187a356f37 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:40:10.288614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:10.297687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc43a10-3364-44b1-9206-621b3385698b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:10.302082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:10.302931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.303206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.303472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.304630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:10.306375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6063dc-6094-450c-9859-c592386d3f66 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:10.307927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 659/1324] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:10 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:10.313640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:10.322914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae786de7-b554-43ba-b45a-d3478d64b1c2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:10.327881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:10.328705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:10.328980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:10.329247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] PATH_INFO: `/v3/users/41f11753c1114966bbbe3e9c7e01675b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:10.342146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=41f11753c1114966bbbe3e9c7e01675b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:10.344878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d0777-801e-41bb-8700-11f3eda029a4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:10.346497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 666/1325] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:10 2021] GET /identity/v3/users/41f11753c1114966bbbe3e9c7e01675b => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:12.632529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d79f2-dfe1-4175-b7e5-5cf7dcb5b0cf None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:12.633105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d79f2-dfe1-4175-b7e5-5cf7dcb5b0cf None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:12.633105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d79f2-dfe1-4175-b7e5-5cf7dcb5b0cf None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:12.634884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 660/1326] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:12.641462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:12.641865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:12.642013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:12.659681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:12.660862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:12.668397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 667/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:12.691812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d79f2-dfe1-4175-b7e5-5cf7dcb5b0cf None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:12.704456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d79f2-dfe1-4175-b7e5-5cf7dcb5b0cf None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:12.708830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:12.709650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:12.709936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:12.710211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] PATH_INFO: `/v3/projects/456843f09d59426cb94a98f47c2e56a7` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:12.721153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] RBAC: Authorizing `identity:get_project(project_id=456843f09d59426cb94a98f47c2e56a7)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:12.723274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:12.724919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 661/1328] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:12 2021] GET /identity/v3/projects/456843f09d59426cb94a98f47c2e56a7 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:12.731313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:12.740045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e882d7c-c00e-4d2e-82c5-80b857054b79 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:12.744518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:12.745139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:12.745417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:12.745687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:12.746482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] RBAC: Adding query filter params (scope.project.id=456843f09d59426cb94a98f47c2e56a7) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:12.746813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:12.749122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad695d25-b6a2-4e39-8bab-872963fd8a79 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:12.754257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 668/1329] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:12 2021] GET /identity/v3/role_assignments?scope.project.id=456843f09d59426cb94a98f47c2e56a7 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:12.760451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:12.770635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905011f-e798-4737-8271-2b2ae26b50af admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:12.775104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:12.775920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:12.776200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:12.776474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] PATH_INFO: `/v3/users/45ab1880190f40abb866cd8a7fd1fe70` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:12.790500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] RBAC: Authorizing `identity:get_user(user_id=45ab1880190f40abb866cd8a7fd1fe70)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:12.792611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea27b23-abcf-4be6-80d6-1d9d6dac9703 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:12.794182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 662/1330] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:12 2021] GET /identity/v3/users/45ab1880190f40abb866cd8a7fd1fe70 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:15.037326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe999c1-9511-48a0-99b1-90310a3910a8 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.037849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe999c1-9511-48a0-99b1-90310a3910a8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.037849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe999c1-9511-48a0-99b1-90310a3910a8 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.039654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 669/1331] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:15.045566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.045975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.046080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.063222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:15.064389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:15.071937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 663/1332] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:15.095836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe999c1-9511-48a0-99b1-90310a3910a8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:15.107600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe999c1-9511-48a0-99b1-90310a3910a8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:15.111967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:15.112783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.113061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.113333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] PATH_INFO: `/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.124056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] RBAC: Authorizing `identity:get_project(project_id=8aad1db3fd8142d8ab02aeba8c6a4fc6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:15.126084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:15.127753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 670/1333] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:15 2021] GET /identity/v3/projects/8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:40:15.134134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:15.143383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7b02-61ff-45b0-a584-adbf93f691b8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:15.147754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:15.148374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.148649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.148918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.149676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] RBAC: Adding query filter params (scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:15.149975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:15.151811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:15.157289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 664/1334] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:15 2021] GET /identity/v3/role_assignments?scope.project.id=8aad1db3fd8142d8ab02aeba8c6a4fc6 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:15.163161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:15.172308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8fff-bb78-4f9f-9315-98cdbd3e1897 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:15.176757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:15.177572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.177851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.178123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] PATH_INFO: `/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.191418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] RBAC: Authorizing `identity:get_user(user_id=07c1a3cc2e5c431cabc58a7234e2fd38)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:15.193504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bda4d7-d575-41bb-80e8-f422abda2d6a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:15.195109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 671/1335] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:15 2021] GET /identity/v3/users/07c1a3cc2e5c431cabc58a7234e2fd38 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:15.200977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:15.210860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc4b9-9e32-471b-bb49-4f7878eb11dc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:15.215301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:15.216126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:15.216399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:15.216667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] PATH_INFO: `/v3/users/42b013ea893d42bf93b4fc4a1e1e7172` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:15.229461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] RBAC: Authorizing `identity:get_user(user_id=42b013ea893d42bf93b4fc4a1e1e7172)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:15.231571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f51e3b-d80d-4f43-9690-bfc89dcc5ff0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:15.233119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 665/1336] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:15 2021] GET /identity/v3/users/42b013ea893d42bf93b4fc4a1e1e7172 => generated 285 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:17.558339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f69e3-37ed-467d-8e1a-eabc7c105aee None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:17.558971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f69e3-37ed-467d-8e1a-eabc7c105aee None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:17.558971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f69e3-37ed-467d-8e1a-eabc7c105aee None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:17.560691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 672/1337] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:17.566680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:17.567087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:17.567249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:17.584587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:17.585763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:17.593971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 666/1338] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:17.617557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f69e3-37ed-467d-8e1a-eabc7c105aee None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:17.629483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f69e3-37ed-467d-8e1a-eabc7c105aee None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:17.634227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:17.635109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:17.635388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:17.635660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] PATH_INFO: `/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:17.646273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] RBAC: Authorizing `identity:get_project(project_id=b6a6ed2acf4d453ab0393eaa990e61d5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:17.648344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:17.649991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 673/1339] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:17 2021] GET /identity/v3/projects/b6a6ed2acf4d453ab0393eaa990e61d5 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:17.656945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:17.665660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c794cdf-68f0-469e-bded-95dd74987819 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:17.670082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:17.670747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:17.671027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:17.671297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:17.672057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] RBAC: Adding query filter params (scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:17.672359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:17.674193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaafb7-4d7a-45ec-b511-4a7fd37a7bc5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:17.679377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 667/1340] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:17 2021] GET /identity/v3/role_assignments?scope.project.id=b6a6ed2acf4d453ab0393eaa990e61d5 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:17.685211 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:17.694390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c828e-274b-4d6c-8140-358263a0c3aa admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:17.698916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:17.699735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:17.700017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:17.700294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] PATH_INFO: `/v3/users/e3b47b5018074c39a39d27d81afa67cb` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:17.713591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] RBAC: Authorizing `identity:get_user(user_id=e3b47b5018074c39a39d27d81afa67cb)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:17.715771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba3a13-8e59-4b72-b806-64b9be114c2e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:17.717944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 674/1341] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:17 2021] GET /identity/v3/users/e3b47b5018074c39a39d27d81afa67cb => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:19.948714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65de40e-8d6b-4ac9-b3af-1152cef83305 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:19.949309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65de40e-8d6b-4ac9-b3af-1152cef83305 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:19.949309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65de40e-8d6b-4ac9-b3af-1152cef83305 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:19.951084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 668/1342] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:19.956986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:19.957393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:19.957533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:19.975344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:19.976536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:19.984994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 675/1343] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:20.009469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65de40e-8d6b-4ac9-b3af-1152cef83305 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:20.021332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65de40e-8d6b-4ac9-b3af-1152cef83305 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:20.025566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:20.026413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:20.026726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:20.026990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] PATH_INFO: `/v3/projects/ba932071ba8140599ec7bb20c2d16789` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:20.037814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba932071ba8140599ec7bb20c2d16789)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:20.039972 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:20.041729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 669/1344] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:20 2021] GET /identity/v3/projects/ba932071ba8140599ec7bb20c2d16789 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:20.048777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:20.057500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2999b0-fd79-48ac-8d60-772f778c965a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:20.062630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:20.063273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:20.063549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:20.063822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:20.064591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] RBAC: Adding query filter params (scope.project.id=ba932071ba8140599ec7bb20c2d16789) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:20.064891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:20.066735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:20.073345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 676/1345] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:20 2021] GET /identity/v3/role_assignments?scope.project.id=ba932071ba8140599ec7bb20c2d16789 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:40:20.079719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:20.089456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b529-7908-465c-97b1-1e721b91d432 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:20.094035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:20.094907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:20.095185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:20.095454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] PATH_INFO: `/v3/users/b0ebbc65a9e348b581a267a279422b57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:20.096642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0ebbc65a9e348b581a267a279422b57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:20.098774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608f1f9-c77f-48f5-a4c3-e68887c78f03 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:20.100344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 670/1346] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:20 2021] GET /identity/v3/users/b0ebbc65a9e348b581a267a279422b57 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:20.106600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:20.116614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ad42-1b37-47b7-92f4-f4251737ef2f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:20.121195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:20.122090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:20.122367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:20.122674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:20.124484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:20.126298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255a70-e362-4c30-a5d1-a16707316b7d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:20.127990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 677/1347] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:20 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:22.434140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abff2-6474-4254-b242-181b890ffbcc None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:22.434596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abff2-6474-4254-b242-181b890ffbcc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:22.434719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abff2-6474-4254-b242-181b890ffbcc None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:22.437142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 671/1348] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:22.443179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:22.443566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:22.443733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:22.460949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:22.462126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:22.470218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 678/1349] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:22.494369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abff2-6474-4254-b242-181b890ffbcc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:22.507123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abff2-6474-4254-b242-181b890ffbcc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:22.511605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:22.512419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:22.512693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:22.512962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] PATH_INFO: `/v3/projects/e2fba8b4340c45198a97460c74be901e` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:22.514137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2fba8b4340c45198a97460c74be901e)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:22.515943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:22.517557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 672/1350] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Oct 18 18:40:22 2021] GET /identity/v3/projects/e2fba8b4340c45198a97460c74be901e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:40:22.523901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:22.533042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca8ae6-112c-4863-bb93-76db348a58db None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:22.537475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:22.538102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:22.538378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:22.538693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:22.539457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] RBAC: Adding query filter params (scope.project.id=e2fba8b4340c45198a97460c74be901e) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:40:22.539761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:22.541564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b361-fd79-4951-a090-46f1582c2746 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:22.547595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 679/1351] 10.222.0.36 () {56 vars in 1231 bytes} [Mon Oct 18 18:40:22 2021] GET /identity/v3/role_assignments?scope.project.id=e2fba8b4340c45198a97460c74be901e => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:22.553515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:22.562962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb635-9c6f-45a5-9696-8e1e7c8d9091 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:22.567416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:22.568223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:22.568509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:22.568779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] PATH_INFO: `/v3/users/ccbaff1ca24443ce904c9dbb2942c081` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:22.569957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ccbaff1ca24443ce904c9dbb2942c081)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:22.571805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61ca0-a1f9-4bb5-9009-d9fa0bfe73f1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:22.573334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 673/1352] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Oct 18 18:40:22 2021] GET /identity/v3/users/ccbaff1ca24443ce904c9dbb2942c081 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:40:27.772032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62be43-a55f-486b-a063-3c13acdd97d3 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:27.772612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62be43-a55f-486b-a063-3c13acdd97d3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:27.772612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62be43-a55f-486b-a063-3c13acdd97d3 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:27.774321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 680/1353] 10.222.0.36 () {54 vars in 918 bytes} [Mon Oct 18 18:40:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:27.780657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0994b2-a7c1-4ea6-b198-6de153a17b8c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:27.781106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0994b2-a7c1-4ea6-b198-6de153a17b8c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:27.781208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0994b2-a7c1-4ea6-b198-6de153a17b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:27.798976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5a0994b2-a7c1-4ea6-b198-6de153a17b8c None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:27.800146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5a0994b2-a7c1-4ea6-b198-6de153a17b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:27.808285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 674/1354] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 18 18:40:27 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:27.823126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbafb-c389-406d-b5de-c0d773bf2aa0 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:27.823408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbafb-c389-406d-b5de-c0d773bf2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:27.823678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbafb-c389-406d-b5de-c0d773bf2aa0 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:27.825382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 681/1355] 10.222.0.36 () {54 vars in 918 bytes} [Mon Oct 18 18:40:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:27.830472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec679b-ea71-47b0-a1ee-bbf116ce96c0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:27.830841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec679b-ea71-47b0-a1ee-bbf116ce96c0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:27.831118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec679b-ea71-47b0-a1ee-bbf116ce96c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:27.848433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-97ec679b-ea71-47b0-a1ee-bbf116ce96c0 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:27.849653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-97ec679b-ea71-47b0-a1ee-bbf116ce96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:27.858986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 675/1356] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 18 18:40:27 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:30.724151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dc13-7640-44c8-94da-17fe94f1b23a None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:30.724693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dc13-7640-44c8-94da-17fe94f1b23a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:30.724693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dc13-7640-44c8-94da-17fe94f1b23a None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:30.726452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 682/1357] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:30.732371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5684d1-c9d7-4901-9a23-abd3104903e9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:30.732802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5684d1-c9d7-4901-9a23-abd3104903e9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:30.732915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5684d1-c9d7-4901-9a23-abd3104903e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:30.750567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2d5684d1-c9d7-4901-9a23-abd3104903e9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:30.751738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2d5684d1-c9d7-4901-9a23-abd3104903e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:30.759574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 676/1358] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:30.802882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45dc13-7640-44c8-94da-17fe94f1b23a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:30.816975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45dc13-7640-44c8-94da-17fe94f1b23a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:30.822169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:30.822814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:30.823090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:30.823361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:30.831664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:30.833233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2f7f-e7a6-414f-8b13-0e2e7d3e7f60 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:30.842094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 683/1359] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:32.311431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066470-6814-4ce9-a9f1-a01ac15ac7f3 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:32.311954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066470-6814-4ce9-a9f1-a01ac15ac7f3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:32.311954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066470-6814-4ce9-a9f1-a01ac15ac7f3 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:32.313702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 677/1360] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:32.319129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94b27-54d6-4230-8606-a46cc1a61371 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:32.319534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94b27-54d6-4230-8606-a46cc1a61371 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:32.319671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94b27-54d6-4230-8606-a46cc1a61371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:32.338190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0ad94b27-54d6-4230-8606-a46cc1a61371 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:32.339398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0ad94b27-54d6-4230-8606-a46cc1a61371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:32.347009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 684/1361] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:32.499265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e066470-6814-4ce9-a9f1-a01ac15ac7f3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:32.514110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e066470-6814-4ce9-a9f1-a01ac15ac7f3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:32.519539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:32.520158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:32.520436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:32.520708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:32.528483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:32.530050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be598f-0abb-4f10-95ed-4cf0e254b9ec service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:32.539098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 678/1362] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:40:33.991322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c32b0-4f66-4039-952e-4adfd519d06c None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:33.991881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c32b0-4f66-4039-952e-4adfd519d06c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:33.991881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c32b0-4f66-4039-952e-4adfd519d06c None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:33.993682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 685/1363] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:33.999804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786b5e-a1dc-4a66-8a6f-238643509021 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:34.000235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786b5e-a1dc-4a66-8a6f-238643509021 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:34.000348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786b5e-a1dc-4a66-8a6f-238643509021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:34.018207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3a786b5e-a1dc-4a66-8a6f-238643509021 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:34.019406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3a786b5e-a1dc-4a66-8a6f-238643509021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:34.026970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 679/1364] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:34.180454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c32b0-4f66-4039-952e-4adfd519d06c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:34.194858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c32b0-4f66-4039-952e-4adfd519d06c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:34.200138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:34.200755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:34.201036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:34.201306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:34.209047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:34.210639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174298d-d60e-4829-9a83-7fe2a27891fe service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:34.219590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 686/1365] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:35.651574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58bf3-c822-4471-ba6c-b1242f05a880 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:35.652125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58bf3-c822-4471-ba6c-b1242f05a880 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:35.652125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58bf3-c822-4471-ba6c-b1242f05a880 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:35.653863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 680/1366] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:35.660125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5cd3-e535-4f7b-87cc-922934155d72 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:35.660572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5cd3-e535-4f7b-87cc-922934155d72 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:35.660677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5cd3-e535-4f7b-87cc-922934155d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:35.677740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2e3a5cd3-e535-4f7b-87cc-922934155d72 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:35.678951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2e3a5cd3-e535-4f7b-87cc-922934155d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:35.686501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 687/1367] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:40:35.845141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58bf3-c822-4471-ba6c-b1242f05a880 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:35.859192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58bf3-c822-4471-ba6c-b1242f05a880 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:35.864461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:35.865085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:35.865367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:35.865640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:35.873478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:35.875082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b527b-2de3-4c27-bc65-e0f853c1d7bd service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:35.884423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 681/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:37.311822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ba49-8e71-46d5-9086-fa9e049bd7ea None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:37.312371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ba49-8e71-46d5-9086-fa9e049bd7ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:37.312371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ba49-8e71-46d5-9086-fa9e049bd7ea None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:37.314182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 688/1369] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:37.319691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4fa5e-19f8-4fd6-a948-ee46ae7fdc02 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:37.320103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4fa5e-19f8-4fd6-a948-ee46ae7fdc02 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:37.320235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4fa5e-19f8-4fd6-a948-ee46ae7fdc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:37.337977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8af4fa5e-19f8-4fd6-a948-ee46ae7fdc02 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:37.339183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8af4fa5e-19f8-4fd6-a948-ee46ae7fdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:37.347368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 682/1370] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:37.496861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811ba49-8e71-46d5-9086-fa9e049bd7ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:37.511579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811ba49-8e71-46d5-9086-fa9e049bd7ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:37.517511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:37.518132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:37.518412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:37.518721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:37.526432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:37.528017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbf1f-cf07-4f00-a9d1-8219b11c3a88 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:37.537015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 689/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:38.905688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfb6a-373c-43aa-acc7-0515c25204df None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:38.906256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfb6a-373c-43aa-acc7-0515c25204df None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:38.906353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfb6a-373c-43aa-acc7-0515c25204df None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:38.908190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 683/1372] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:38.913517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baea5db-c552-4718-800f-cfd9972ce24d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:38.913953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baea5db-c552-4718-800f-cfd9972ce24d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:38.914092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baea5db-c552-4718-800f-cfd9972ce24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:38.931748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3baea5db-c552-4718-800f-cfd9972ce24d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:38.932957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3baea5db-c552-4718-800f-cfd9972ce24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:38.941636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 690/1373] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:39.092694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfb6a-373c-43aa-acc7-0515c25204df None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:39.106622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfb6a-373c-43aa-acc7-0515c25204df None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:39.112455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:39.113083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:39.113362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:39.113634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:39.121373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:39.123027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0b814-c841-4682-bf3b-396f1d007d3b service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:39.132688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 684/1374] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:40.511621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7a36-2f96-46c6-aea7-215a5cad34b3 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:40.512186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7a36-2f96-46c6-aea7-215a5cad34b3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:40.512186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b7a36-2f96-46c6-aea7-215a5cad34b3 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:40.514602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 691/1375] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:40.520023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2536c-a8db-446f-a004-c3dcef650ed8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:40.520451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2536c-a8db-446f-a004-c3dcef650ed8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:40.520560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2536c-a8db-446f-a004-c3dcef650ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:40.537588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2bd2536c-a8db-446f-a004-c3dcef650ed8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:40.538796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2bd2536c-a8db-446f-a004-c3dcef650ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:40.546283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 685/1376] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:40.699179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b7a36-2f96-46c6-aea7-215a5cad34b3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:40.713536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b7a36-2f96-46c6-aea7-215a5cad34b3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:40.718887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:40.719507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:40.719787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:40.720061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:40.727793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:40.729351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890f66-fefc-46bc-bcc2-0bdc498ef9da service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:40.738359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 692/1377] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:42.139843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561d67-d8a0-4799-84dd-085b68fcafd3 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:42.140377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561d67-d8a0-4799-84dd-085b68fcafd3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:42.140377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561d67-d8a0-4799-84dd-085b68fcafd3 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:42.142117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 686/1378] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:42.147545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3d48-5d77-41fc-b769-c82791bdf027 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:42.147969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3d48-5d77-41fc-b769-c82791bdf027 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:42.148075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3d48-5d77-41fc-b769-c82791bdf027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:42.165259 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-494f3d48-5d77-41fc-b769-c82791bdf027 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:42.166440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-494f3d48-5d77-41fc-b769-c82791bdf027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:42.174060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 693/1379] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:42.323984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561d67-d8a0-4799-84dd-085b68fcafd3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:42.338190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561d67-d8a0-4799-84dd-085b68fcafd3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:42.343512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:42.344128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:42.344404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:42.344673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:42.352342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:42.353922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf64c-0a06-4d97-86f8-b9af8028cbd6 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:42.363385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 687/1380] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:43.746626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a521-cf0f-4d68-ad7c-c8f56dba0edf None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:43.747227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a521-cf0f-4d68-ad7c-c8f56dba0edf None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:43.747227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a521-cf0f-4d68-ad7c-c8f56dba0edf None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:43.749481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 694/1381] 10.222.0.36 () {54 vars in 911 bytes} [Mon Oct 18 18:40:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:43.754952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf71e-9e0d-40f5-9861-8a586257a8ca None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:43.755638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf71e-9e0d-40f5-9861-8a586257a8ca None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:43.755750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cf71e-9e0d-40f5-9861-8a586257a8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:43.774222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6e9cf71e-9e0d-40f5-9861-8a586257a8ca None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:43.775434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6e9cf71e-9e0d-40f5-9861-8a586257a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:43.783289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 688/1382] 10.222.0.36 () {58 vars in 1008 bytes} [Mon Oct 18 18:40:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:43.941110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a521-cf0f-4d68-ad7c-c8f56dba0edf None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:43.954957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a521-cf0f-4d68-ad7c-c8f56dba0edf None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:43.960212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:43.960856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:43.961137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:43.961412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:43.969183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:43.970782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8b80-955c-433f-9837-5032b39bf325 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:43.979982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 695/1383] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:46.106347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fccd1-e54b-4f6b-a848-e5674ca0992f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:46.107463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fccd1-e54b-4f6b-a848-e5674ca0992f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:46.107773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fccd1-e54b-4f6b-a848-e5674ca0992f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:46.109579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 689/1384] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:46.115680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb25d-4814-496f-a430-3a543e2b287c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:46.116089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb25d-4814-496f-a430-3a543e2b287c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:46.116231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb25d-4814-496f-a430-3a543e2b287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:46.134234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0ffbb25d-4814-496f-a430-3a543e2b287c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:46.135460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0ffbb25d-4814-496f-a430-3a543e2b287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:46.143062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 696/1385] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:46.182150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fccd1-e54b-4f6b-a848-e5674ca0992f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:46.193073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fccd1-e54b-4f6b-a848-e5674ca0992f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:46.196567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:46.197190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:46.197470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:46.197745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:46.206225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:46.207688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a773f-bd86-48f8-af6d-bcc6016482f4 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:46.216725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 690/1386] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:48.595167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b748-60fc-4fb1-86ee-a23555e7b883 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:48.595769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b748-60fc-4fb1-86ee-a23555e7b883 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:48.595769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b748-60fc-4fb1-86ee-a23555e7b883 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:48.597468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 697/1387] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:48.603409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090cfc6-9102-4900-9b11-6b3e9be2cb8b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:48.603816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090cfc6-9102-4900-9b11-6b3e9be2cb8b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:48.603954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090cfc6-9102-4900-9b11-6b3e9be2cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:48.621120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5090cfc6-9102-4900-9b11-6b3e9be2cb8b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:48.622297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5090cfc6-9102-4900-9b11-6b3e9be2cb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:48.629812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 691/1388] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:48.672780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2b748-60fc-4fb1-86ee-a23555e7b883 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:48.682946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2b748-60fc-4fb1-86ee-a23555e7b883 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:48.686425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:48.687069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:48.687347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:48.687617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:48.695960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:48.697365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9426538-da5c-4f6e-be6c-f754c058931c service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:48.706786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 698/1389] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:40:51.289370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16552b3-a3b1-4ecd-aab8-9f2132b7071f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:51.289897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16552b3-a3b1-4ecd-aab8-9f2132b7071f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:51.289897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16552b3-a3b1-4ecd-aab8-9f2132b7071f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:51.291660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 692/1390] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:51.297630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc67d-7584-4128-a10d-80dbab40b4e3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:51.298067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc67d-7584-4128-a10d-80dbab40b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:51.298178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc67d-7584-4128-a10d-80dbab40b4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:51.315670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-aefcc67d-7584-4128-a10d-80dbab40b4e3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:51.316843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-aefcc67d-7584-4128-a10d-80dbab40b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:51.324368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 699/1391] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:51.363563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16552b3-a3b1-4ecd-aab8-9f2132b7071f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:51.374495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16552b3-a3b1-4ecd-aab8-9f2132b7071f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:51.378802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:51.379418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:51.379691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:51.379959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:51.388814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:51.390211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d226f0-b4ef-44f1-85c6-a096f99d8aad service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:51.399134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 693/1392] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:53.749658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12221879-4e47-4842-b77f-56ad220b0d15 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:53.750191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12221879-4e47-4842-b77f-56ad220b0d15 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:53.750191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12221879-4e47-4842-b77f-56ad220b0d15 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:53.751905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 700/1393] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:53.758005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b797-9c00-4056-8f75-66d8dc2f39d8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:53.758418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b797-9c00-4056-8f75-66d8dc2f39d8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:53.758581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b797-9c00-4056-8f75-66d8dc2f39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:53.775906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8ef0b797-9c00-4056-8f75-66d8dc2f39d8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:53.777078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8ef0b797-9c00-4056-8f75-66d8dc2f39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:53.784672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 694/1394] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:53.824797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12221879-4e47-4842-b77f-56ad220b0d15 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:53.834947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12221879-4e47-4842-b77f-56ad220b0d15 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:53.838349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:53.838997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:53.839275 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:53.839546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:53.847899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:53.849304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ac699-f161-450a-9bfe-efb0160a79ef service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:53.858968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 701/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:56.168146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4604e87-8e75-4fa7-8d58-36a4fae47144 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:56.168689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4604e87-8e75-4fa7-8d58-36a4fae47144 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:56.168689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4604e87-8e75-4fa7-8d58-36a4fae47144 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:56.171062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 695/1396] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:56.177241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cae7-3b49-4fdd-ac68-ca44691b7078 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:56.177680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cae7-3b49-4fdd-ac68-ca44691b7078 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:56.177797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cae7-3b49-4fdd-ac68-ca44691b7078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:56.205455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f437cae7-3b49-4fdd-ac68-ca44691b7078 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:56.206664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f437cae7-3b49-4fdd-ac68-ca44691b7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:56.214286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 702/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:56.254186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4604e87-8e75-4fa7-8d58-36a4fae47144 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:56.264738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4604e87-8e75-4fa7-8d58-36a4fae47144 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:56.268267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:56.268886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:56.269164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:56.269437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:56.278037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:56.280032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b67703-12ae-4ac4-9b63-cd217e63cda2 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:56.289359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 696/1398] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:40:58.581132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfa21-68d0-48ac-8fff-32298f8dc13b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:58.581702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfa21-68d0-48ac-8fff-32298f8dc13b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:58.581702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bfa21-68d0-48ac-8fff-32298f8dc13b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:58.583493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 703/1399] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:40:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:40:58.589500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218c65-43da-440f-9f95-56ceaf60c3f5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:58.589940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218c65-43da-440f-9f95-56ceaf60c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:58.590039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218c65-43da-440f-9f95-56ceaf60c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:58.608624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8c218c65-43da-440f-9f95-56ceaf60c3f5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:40:58.609800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8c218c65-43da-440f-9f95-56ceaf60c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:40:58.617348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 697/1400] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:40:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:40:58.656847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bfa21-68d0-48ac-8fff-32298f8dc13b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:40:58.667204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bfa21-68d0-48ac-8fff-32298f8dc13b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:40:58.671209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:40:58.671833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:40:58.672114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:40:58.672389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:40:58.681112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:40:58.682538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb8766-7acb-4cd8-a53e-8d7140149d23 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:40:58.692278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 704/1401] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:40:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:41:00.985336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799678-c1f3-4dd0-9f46-9ec862286318 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:00.986010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799678-c1f3-4dd0-9f46-9ec862286318 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:00.986010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799678-c1f3-4dd0-9f46-9ec862286318 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:00.987685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 698/1402] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:00.993923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93bb5-d770-4661-bd23-b9ed867eb48b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:00.994351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93bb5-d770-4661-bd23-b9ed867eb48b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:00.994465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93bb5-d770-4661-bd23-b9ed867eb48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:01.012840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2ee93bb5-d770-4661-bd23-b9ed867eb48b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:01.014015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2ee93bb5-d770-4661-bd23-b9ed867eb48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:01.021494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 705/1403] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:01.059955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18799678-c1f3-4dd0-9f46-9ec862286318 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:01.070836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18799678-c1f3-4dd0-9f46-9ec862286318 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:01.074289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:01.074956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:01.075238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:01.075519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:01.084043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:01.085464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd816a4-3e94-4a7c-8393-ba4eea95c83b service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:01.094514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 699/1404] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:03.468142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4391b-5a84-4d1d-acb7-c5a47083af3b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:03.468142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4391b-5a84-4d1d-acb7-c5a47083af3b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:03.468142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4391b-5a84-4d1d-acb7-c5a47083af3b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:03.471210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 706/1405] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:03.478158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f652-5cf4-4b23-9d9e-c5a5cbf71cca None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:03.478673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f652-5cf4-4b23-9d9e-c5a5cbf71cca None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:03.478782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f652-5cf4-4b23-9d9e-c5a5cbf71cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:03.496719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7076f652-5cf4-4b23-9d9e-c5a5cbf71cca None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:03.497940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7076f652-5cf4-4b23-9d9e-c5a5cbf71cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:03.506132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 700/1406] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:03.545512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4391b-5a84-4d1d-acb7-c5a47083af3b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:03.555934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4391b-5a84-4d1d-acb7-c5a47083af3b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:03.559433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:03.560060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:03.560342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:03.560618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:03.569236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:03.570695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416684-acd2-46eb-ad6b-cbfe1dc6f7c3 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:03.579993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 707/1407] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:05.835329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a492299-e3cc-4f75-ae14-5dc466ec77da None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:05.836048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a492299-e3cc-4f75-ae14-5dc466ec77da None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:05.836048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a492299-e3cc-4f75-ae14-5dc466ec77da None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:05.837630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 701/1408] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:05.843740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d0676-892a-4bb4-b280-ce97ec091069 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:05.844196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d0676-892a-4bb4-b280-ce97ec091069 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:05.844304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d0676-892a-4bb4-b280-ce97ec091069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:05.861557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4d5d0676-892a-4bb4-b280-ce97ec091069 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:05.862787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4d5d0676-892a-4bb4-b280-ce97ec091069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:05.870441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 708/1409] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:41:05.908538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a492299-e3cc-4f75-ae14-5dc466ec77da None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:05.918945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a492299-e3cc-4f75-ae14-5dc466ec77da None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:05.922390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:05.923046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:05.923329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:05.923602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:05.932163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:05.933582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c2cd-b6cc-4e43-b6a4-b7d934ba1c48 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:05.943144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 702/1410] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:08.182472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be637-3e20-44bc-a0d8-a7535d9178b1 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:08.183039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be637-3e20-44bc-a0d8-a7535d9178b1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:08.183039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be637-3e20-44bc-a0d8-a7535d9178b1 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:08.184849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 709/1411] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:08.190844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d219f4-53e3-4893-89ff-56cb4302cb45 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:08.191254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d219f4-53e3-4893-89ff-56cb4302cb45 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:08.191384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d219f4-53e3-4893-89ff-56cb4302cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:08.208411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-69d219f4-53e3-4893-89ff-56cb4302cb45 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:08.209579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-69d219f4-53e3-4893-89ff-56cb4302cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:08.217620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 703/1412] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:08.255710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be637-3e20-44bc-a0d8-a7535d9178b1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:08.266667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be637-3e20-44bc-a0d8-a7535d9178b1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:08.270103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:08.270760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:08.271040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:08.271315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:08.280360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:08.281771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0c15-0b1e-4e64-a5e3-408bbd30fb7a service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:08.290635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 710/1413] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:25.017104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5587304-fc6a-46d8-8b93-2412d6eedcea None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:25.017592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5587304-fc6a-46d8-8b93-2412d6eedcea None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:25.017708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5587304-fc6a-46d8-8b93-2412d6eedcea None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:25.019452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 704/1414] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:25.025262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6fe7-2999-4416-b8cc-41999dac5199 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:25.025664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6fe7-2999-4416-b8cc-41999dac5199 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:25.025825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6fe7-2999-4416-b8cc-41999dac5199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:25.044298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9b9c6fe7-2999-4416-b8cc-41999dac5199 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:25.045473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9b9c6fe7-2999-4416-b8cc-41999dac5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:25.053249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 711/1415] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:25.103240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4eb9-4a89-413f-9675-1596864bfbf4 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:25.103528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4eb9-4a89-413f-9675-1596864bfbf4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:25.103802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4eb9-4a89-413f-9675-1596864bfbf4 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:25.105545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 705/1416] 10.222.0.36 () {54 vars in 962 bytes} [Mon Oct 18 18:41:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:25.110782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb93c-7e5f-4a5f-bf93-6e144ca6aaba None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:25.111076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb93c-7e5f-4a5f-bf93-6e144ca6aaba None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:25.111360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb93c-7e5f-4a5f-bf93-6e144ca6aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:25.130382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-76abb93c-7e5f-4a5f-bf93-6e144ca6aaba None None] MFA Rules not processed for user `d34f3e4c4a4244128b8d4d1ba548d270`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:25.131598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-76abb93c-7e5f-4a5f-bf93-6e144ca6aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:25.138471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 712/1417] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Oct 18 18:41:25 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:25.145909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4eb9-4a89-413f-9675-1596864bfbf4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:25.156016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4eb9-4a89-413f-9675-1596864bfbf4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:25.159455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:25.160065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:25.160354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:25.160613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:25.169142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:25.170575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d42ec-4862-4ecf-b797-bc26319542f5 service glance] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:25.179573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 706/1418] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:27.635167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe77f0-57b9-4c12-9e5f-a71fa23f9380 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:27.635749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe77f0-57b9-4c12-9e5f-a71fa23f9380 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:27.635749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe77f0-57b9-4c12-9e5f-a71fa23f9380 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:27.637975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 713/1419] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:27.644079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5ecf-ed46-4bfa-b2e1-20b6b4806d95 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:27.644524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5ecf-ed46-4bfa-b2e1-20b6b4806d95 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:27.644630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5ecf-ed46-4bfa-b2e1-20b6b4806d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:27.662577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-512d5ecf-ed46-4bfa-b2e1-20b6b4806d95 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:27.664420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-512d5ecf-ed46-4bfa-b2e1-20b6b4806d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:27.671404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 707/1420] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:27.695251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe77f0-57b9-4c12-9e5f-a71fa23f9380 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:27.707573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe77f0-57b9-4c12-9e5f-a71fa23f9380 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:27.711848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:27.712477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:27.712749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:27.713017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:27.713742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:27.716198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28401fa2-6d1a-44dd-8bb8-56d3a65ae01c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:27.734091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 714/1421] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Oct 18 18:41:27 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:41:30.004543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fee9c-970a-4763-9289-3a1c7d38e248 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:30.005298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fee9c-970a-4763-9289-3a1c7d38e248 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:30.005395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fee9c-970a-4763-9289-3a1c7d38e248 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:30.007146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 708/1422] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:30.013014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a47be-e1df-4f59-972b-a22cad6be02c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:30.013438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a47be-e1df-4f59-972b-a22cad6be02c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:30.013567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a47be-e1df-4f59-972b-a22cad6be02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:30.030863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-684a47be-e1df-4f59-972b-a22cad6be02c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:30.032053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-684a47be-e1df-4f59-972b-a22cad6be02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:30.039628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 715/1423] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:30.083654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fee9c-970a-4763-9289-3a1c7d38e248 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:30.097496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fee9c-970a-4763-9289-3a1c7d38e248 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:30.102797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:30.103421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:30.103692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:30.103960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:30.112286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:30.113869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53a3ee-5757-47f3-a14c-f1cff2682231 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:30.123428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 709/1424] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:32.528317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fd1c-d7c0-41c9-8c42-019870a6f71f None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:32.528904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fd1c-d7c0-41c9-8c42-019870a6f71f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:32.528904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fd1c-d7c0-41c9-8c42-019870a6f71f None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:32.530652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 716/1425] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:32.536465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e3b3-14ce-4d36-a2d1-ee218cdb755a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:32.536895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e3b3-14ce-4d36-a2d1-ee218cdb755a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:32.537019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e3b3-14ce-4d36-a2d1-ee218cdb755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:32.554589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1ad7e3b3-14ce-4d36-a2d1-ee218cdb755a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:32.555780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1ad7e3b3-14ce-4d36-a2d1-ee218cdb755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:32.563434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 710/1426] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:32.600839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65fd1c-d7c0-41c9-8c42-019870a6f71f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:32.611620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65fd1c-d7c0-41c9-8c42-019870a6f71f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:32.615042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:32.615661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:32.615938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:32.616214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:32.624653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:32.626053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c3244-b004-4dcb-9637-e322e3341c19 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:32.635153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 717/1427] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:34.917432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55395088-cc92-4887-9971-3e0b3523ba97 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:34.918024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55395088-cc92-4887-9971-3e0b3523ba97 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:34.918024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55395088-cc92-4887-9971-3e0b3523ba97 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:34.919827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 711/1428] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:34.925572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55666b1-c79f-4ff7-a7bd-8d30f12c9a8b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:34.925986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55666b1-c79f-4ff7-a7bd-8d30f12c9a8b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:34.926121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55666b1-c79f-4ff7-a7bd-8d30f12c9a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:34.943978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d55666b1-c79f-4ff7-a7bd-8d30f12c9a8b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:34.945149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d55666b1-c79f-4ff7-a7bd-8d30f12c9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:34.953276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 718/1429] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:34.992380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55395088-cc92-4887-9971-3e0b3523ba97 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:35.003854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55395088-cc92-4887-9971-3e0b3523ba97 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:35.007691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:35.008312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:35.008590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:35.008857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:35.017327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:35.018756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc5f3-4918-4f5a-bbd5-764286b4dd25 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:35.027746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 712/1430] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:41:37.344682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ffd1-488a-46f6-901e-9458193ebab6 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:37.345244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ffd1-488a-46f6-901e-9458193ebab6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:37.345244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ffd1-488a-46f6-901e-9458193ebab6 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:37.347016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 719/1431] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:37.352826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be65bc-63b8-4ad7-944b-fc77c071acab None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:37.353245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be65bc-63b8-4ad7-944b-fc77c071acab None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:37.353378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be65bc-63b8-4ad7-944b-fc77c071acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:37.370994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-55be65bc-63b8-4ad7-944b-fc77c071acab None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:37.372185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-55be65bc-63b8-4ad7-944b-fc77c071acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:37.380308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 713/1432] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:37.422262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ffd1-488a-46f6-901e-9458193ebab6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:37.432526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ffd1-488a-46f6-901e-9458193ebab6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:37.435968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:37.436588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:37.436867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:37.437140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:37.445603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:37.447052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc1ba3-4d2b-47ea-9198-379304446367 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:37.456526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 720/1433] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:41:39.890127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:39.890766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:39.890766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:39.892465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 714/1434] 10.222.0.36 () {54 vars in 926 bytes} [Mon Oct 18 18:41:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:41:39.898427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db543-f40d-4dba-ba43-2c1a404d54e8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:39.898902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db543-f40d-4dba-ba43-2c1a404d54e8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:39.899015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db543-f40d-4dba-ba43-2c1a404d54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:39.916085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b86db543-f40d-4dba-ba43-2c1a404d54e8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:41:39.917260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b86db543-f40d-4dba-ba43-2c1a404d54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:39.924850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 721/1435] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Oct 18 18:41:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:41:39.966524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:41:39.968205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:41:39.980786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4838-3a50-48db-bb69-39c59a619ab8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:41:39.984301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:41:39.984922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:41:39.985195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:41:39.985461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:41:39.994167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:41:39.995614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45365a-3fdc-490d-a33a-2167efd3638f service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:41:40.005447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 715/1436] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:41:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:42:58.122422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.123036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.123036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.140783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:42:58.141955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:58.149513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 722/1437] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:42:58.157642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.158130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.158238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.176105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:42:58.177268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:58.185683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 716/1438] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:42:58.190068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.199122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45847-d88e-48a4-ae44-e43895493603 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.203625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.204268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.204545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.204817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.205541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:42:58.205840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.207444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.218399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 723/1439] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:42:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:42:58.225992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.235168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3aee8-d12c-4e7c-8cbf-529fa428c6ec None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.239555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.240181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.240455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.240724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.241418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.243380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.278491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 717/1440] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:42:58.282771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.292795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c8d1-7047-494c-b371-847a80526085 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.344986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.345636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.345920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.346198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.347002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.348925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.368408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 724/1441] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:42:58.372608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.384177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879feea8-5742-4262-981c-59f45bcfcc95 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.388598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.389237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.389511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.389780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.390531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.392159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.404663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 718/1442] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:42:58.408424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.418637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb23b3-0f82-4251-b1a4-5977601f7f19 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.423268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.423908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.424190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.424466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.425190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.426805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3724-27ea-42be-bcc4-0eac65128cf9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.439366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 725/1443] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:42:58.443162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.452357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dca97e-735f-4e84-baf5-2bbd37a082bd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.457030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.457883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.458165 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.458437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] PATH_INFO: `/v3/projects/deccebde4df24c22a13b290a0f56a11f/users/29f07d6651bf4fd1baf6bb311c781b89/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.473054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deccebde4df24c22a13b290a0f56a11f, user_id=29f07d6651bf4fd1baf6bb311c781b89, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.475809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.489310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 719/1444] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:42:58 2021] PUT /identity/v3/projects/deccebde4df24c22a13b290a0f56a11f/users/29f07d6651bf4fd1baf6bb311c781b89/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:42:58.501326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33528-86c9-42e4-982f-2151c3403d5a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.501551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33528-86c9-42e4-982f-2151c3403d5a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.501829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33528-86c9-42e4-982f-2151c3403d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.528980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c0d33528-86c9-42e4-982f-2151c3403d5a None None] MFA Rules not processed for user `29f07d6651bf4fd1baf6bb311c781b89`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:42:58.530310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c0d33528-86c9-42e4-982f-2151c3403d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:58.591778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 726/1445] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:42:58.603728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.668745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74786d-9a93-455b-bffd-f7490d05b2e8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.674001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.674649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.674925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.675200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.682656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.684230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.699589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 720/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:42:58 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:42:58.765976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe5a5-243b-4bea-a83f-aa6dae3b58f5 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.766261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe5a5-243b-4bea-a83f-aa6dae3b58f5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.766532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe5a5-243b-4bea-a83f-aa6dae3b58f5 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.768570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 727/1447] 10.222.0.36 () {52 vars in 829 bytes} [Mon Oct 18 18:42:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:42:58.772211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:58.830092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658026d3-fbea-4164-84a3-928275ada845 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:58.834587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:58.835427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.835700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.835966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] PATH_INFO: `/v3/users/29f07d6651bf4fd1baf6bb311c781b89` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.837147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f07d6651bf4fd1baf6bb311c781b89)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:58.838795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:42:58.838795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:42:58.838795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:42:58.839993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:58.905630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f07d6651bf4fd1baf6bb311c781b89'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:58.925032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f07d6651bf4fd1baf6bb311c781b89'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:58.936680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f07d6651bf4fd1baf6bb311c781b89'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:58.937467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f07d6651bf4fd1baf6bb311c781b89'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:58.938089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f07d6651bf4fd1baf6bb311c781b89'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:58.953046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 721/1448] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:42:58 2021] DELETE /identity/v3/users/29f07d6651bf4fd1baf6bb311c781b89 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:42:58.957675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:58.957956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:58.958229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:58.975952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:42:58.977145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:59.045007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 728/1449] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:42:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:42:59.054814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:59.056701 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:59.109546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ea45-54ae-4a27-bf4f-b67f294757ed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:59.113110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:59.113740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:59.114020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:59.114294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:59.123367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:59.124793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c44bf-127e-47df-8df7-421c649587e2 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:59.134058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 722/1450] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:42:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:42:59.493924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:42:59.495968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:42:59.507970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce745a-45c4-40f0-8968-9ebaea89b9cc None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:42:59.513045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:42:59.513910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:42:59.514195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:42:59.514451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] PATH_INFO: `/v3/projects/deccebde4df24c22a13b290a0f56a11f` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:42:59.515701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=deccebde4df24c22a13b290a0f56a11f)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:42:59.516718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:42:59.516718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:42:59.516718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:42:59.518263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:42:59.576288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deccebde4df24c22a13b290a0f56a11f', 'request_id': 'req-4dc53547-3900-47f0-a183-c6c54ad98ead'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:59.581763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deccebde4df24c22a13b290a0f56a11f', 'request_id': 'req-4dc53547-3900-47f0-a183-c6c54ad98ead'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:59.590409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deccebde4df24c22a13b290a0f56a11f', 'request_id': 'req-4dc53547-3900-47f0-a183-c6c54ad98ead'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:59.608278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] The token cache is being invalidate because project deccebde4df24c22a13b290a0f56a11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:42:59.608561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:59.609273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4dc53547-3900-47f0-a183-c6c54ad98ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:42:59.610814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 729/1451] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:42:59 2021] DELETE /identity/v3/projects/deccebde4df24c22a13b290a0f56a11f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:44:25.194350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:25.194973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:25.194973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:25.196728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 723/1452] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 18 18:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:25.202507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dcc18-db9d-42d1-a135-02678febc3df None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:25.202967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dcc18-db9d-42d1-a135-02678febc3df None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:25.203069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dcc18-db9d-42d1-a135-02678febc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:25.220389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-033dcc18-db9d-42d1-a135-02678febc3df None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:25.221568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-033dcc18-db9d-42d1-a135-02678febc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:25.277440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 730/1453] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 18 18:44:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:44:25.432396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:25.434661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:25.505387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e98c7-624f-441f-b4c8-37ce9f35170f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:25.510768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:25.511434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:25.511716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:25.511993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:25.519851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:25.521513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7be45-20bf-4b67-b2d3-d95fbc3716ed service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:25.530790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 724/1454] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:26.201885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4dca-94da-4046-bc9e-841810407fd0 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:26.202171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4dca-94da-4046-bc9e-841810407fd0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:26.202446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc4dca-94da-4046-bc9e-841810407fd0 None None] PATH_INFO: `/v3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:26.203799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 731/1455] 10.222.0.25 () {54 vars in 925 bytes} [Mon Oct 18 18:44:26 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:44:26.210719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5138b-8a3f-46ff-abff-7406b714cdec None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:26.211157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5138b-8a3f-46ff-abff-7406b714cdec None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:26.211299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5138b-8a3f-46ff-abff-7406b714cdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:26.229389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e6f5138b-8a3f-46ff-abff-7406b714cdec None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:26.230636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e6f5138b-8a3f-46ff-abff-7406b714cdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:26.300761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 725/1456] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 18 18:44:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:26.979414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39eb2b-2a1d-4291-8134-0182da58efe0 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:26.980240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39eb2b-2a1d-4291-8134-0182da58efe0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:26.980524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39eb2b-2a1d-4291-8134-0182da58efe0 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:26.982302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 18 18:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:26.987891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38683c-a96f-4d5a-a5f0-91ba828bf4f3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:26.988184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38683c-a96f-4d5a-a5f0-91ba828bf4f3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:26.988467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38683c-a96f-4d5a-a5f0-91ba828bf4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:27.007123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ee38683c-a96f-4d5a-a5f0-91ba828bf4f3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:27.008323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ee38683c-a96f-4d5a-a5f0-91ba828bf4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:27.016067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 18 18:44:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:27.176338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39eb2b-2a1d-4291-8134-0182da58efe0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:27.191079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39eb2b-2a1d-4291-8134-0182da58efe0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:27.196575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:27.197208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:27.197488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:27.197761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:27.205655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:27.207267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2b258-7df2-43f6-a612-bd92beda4b5f service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:27.217182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 733/1459] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:29.979435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70f1c-96bf-4541-a3b3-71594b824503 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:29.980437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70f1c-96bf-4541-a3b3-71594b824503 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:29.980534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70f1c-96bf-4541-a3b3-71594b824503 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:29.982300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 727/1460] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:44:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:29.987684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79090ef-6ca4-4253-9259-e290f3d08bd9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:29.988139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79090ef-6ca4-4253-9259-e290f3d08bd9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:29.988248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79090ef-6ca4-4253-9259-e290f3d08bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:30.006941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a79090ef-6ca4-4253-9259-e290f3d08bd9 None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:30.008832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a79090ef-6ca4-4253-9259-e290f3d08bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:30.019297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 734/1461] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:44:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:30.027108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd70f1c-96bf-4541-a3b3-71594b824503 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:30.040289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd70f1c-96bf-4541-a3b3-71594b824503 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:30.045660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:30.046280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:30.046575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:30.046854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:30.054951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:30.056525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ebf0-bfe5-4f67-8a8e-cd4c5311ae3d service placement] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:30.066406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 728/1462] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:39.038867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f36-329e-4745-b642-d0979967f724 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:39.039317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f36-329e-4745-b642-d0979967f724 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:39.039412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f36-329e-4745-b642-d0979967f724 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:39.041197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 18 18:44:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:39.047217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adb87-9ecb-4089-8d90-1e2bfb354412 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:39.047660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adb87-9ecb-4089-8d90-1e2bfb354412 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:39.047778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adb87-9ecb-4089-8d90-1e2bfb354412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:39.066100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8b1adb87-9ecb-4089-8d90-1e2bfb354412 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:39.067331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8b1adb87-9ecb-4089-8d90-1e2bfb354412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:39.075004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 18 18:44:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:39.228503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0f36-329e-4745-b642-d0979967f724 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:39.243167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0f36-329e-4745-b642-d0979967f724 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:39.248685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:39.249339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:39.249618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:39.249893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:39.258100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:39.259709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dc283-f25c-4848-bee6-aeb544d01fa9 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:39.268666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 736/1465] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:40.690404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4518-deac-4611-bdd3-deee4f5e33d7 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:40.690983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4518-deac-4611-bdd3-deee4f5e33d7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:40.690983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4518-deac-4611-bdd3-deee4f5e33d7 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:40.692751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 18 18:44:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:40.697946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a540-5122-4f9e-bff6-6e2731085318 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:40.698945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a540-5122-4f9e-bff6-6e2731085318 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:40.699098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a540-5122-4f9e-bff6-6e2731085318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:40.716523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-40b5a540-5122-4f9e-bff6-6e2731085318 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:40.717723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-40b5a540-5122-4f9e-bff6-6e2731085318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:40.725795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 18 18:44:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:40.880473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4518-deac-4611-bdd3-deee4f5e33d7 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:40.894940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4518-deac-4611-bdd3-deee4f5e33d7 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:40.900210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:40.900832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:40.901107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:40.901501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:40.909283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:40.910907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9c510-26e7-475a-bd1b-c8f69ade4ef9 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:40.919800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 731/1468] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:44.941633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:44.942213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:44.942213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:44.943994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 738/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 18 18:44:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:44.950160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61699cb-7c36-4f80-94cd-03be253e53b8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:44.950576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61699cb-7c36-4f80-94cd-03be253e53b8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:44.950745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61699cb-7c36-4f80-94cd-03be253e53b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:44.968646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-f61699cb-7c36-4f80-94cd-03be253e53b8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:44.969821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f61699cb-7c36-4f80-94cd-03be253e53b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:44.977588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 732/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 18 18:44:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:45.016577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:45.018268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:45.071847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0663c8-feb0-4fe9-ad45-80012d51da6b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:45.075902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:45.076523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:45.076799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:45.077068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:45.085895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:45.087321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbcc44-0382-4fb5-a0e7-7ca9335acd14 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:45.097058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 739/1471] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:47.365721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94ed1-0b3c-4db4-9a8f-24b9be67372a None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:47.366280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94ed1-0b3c-4db4-9a8f-24b9be67372a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:47.366280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94ed1-0b3c-4db4-9a8f-24b9be67372a None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:47.368092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 733/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 18 18:44:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:47.374470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f24cb-6f5e-456f-afe6-087b77352fd2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:47.374932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f24cb-6f5e-456f-afe6-087b77352fd2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:47.375083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f24cb-6f5e-456f-afe6-087b77352fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:47.393770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4c4f24cb-6f5e-456f-afe6-087b77352fd2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:47.395026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4c4f24cb-6f5e-456f-afe6-087b77352fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:47.402716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 740/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 18 18:44:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:47.440239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b94ed1-0b3c-4db4-9a8f-24b9be67372a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:47.451158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b94ed1-0b3c-4db4-9a8f-24b9be67372a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:47.454689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:47.455315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:47.455596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:47.455868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:47.464563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:47.465991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ac09-8fcd-4894-8951-da7a27fe0409 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:47.475199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 734/1474] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:51.249330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:51.249883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:51.249883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:51.251590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 741/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 18 18:44:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:51.257527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175456f-c3d7-4d0d-9139-75a7ac894292 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:51.257978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175456f-c3d7-4d0d-9139-75a7ac894292 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:51.258093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175456f-c3d7-4d0d-9139-75a7ac894292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:51.276485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2175456f-c3d7-4d0d-9139-75a7ac894292 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:51.277680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2175456f-c3d7-4d0d-9139-75a7ac894292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:51.285344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 735/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 18 18:44:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:51.336459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:51.338073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:51.391416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67e16-68f2-43c9-bcba-42b0b665d978 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:51.394856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:51.395479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:51.395756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:51.396031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:51.404310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:51.405709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc68b62-169b-433d-9bed-79c579eca865 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:51.414525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 742/1477] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:44:53.657704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb126b-d58d-4316-b28c-ea5ecc462983 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:53.658278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb126b-d58d-4316-b28c-ea5ecc462983 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:53.658278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb126b-d58d-4316-b28c-ea5ecc462983 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:53.660027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 736/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Oct 18 18:44:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:53.665591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32315c-e898-4b0f-8294-6b13d7bcd2dd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:53.666010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32315c-e898-4b0f-8294-6b13d7bcd2dd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:53.666134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32315c-e898-4b0f-8294-6b13d7bcd2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:53.684307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6b32315c-e898-4b0f-8294-6b13d7bcd2dd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:53.685506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6b32315c-e898-4b0f-8294-6b13d7bcd2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:53.693164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 743/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Oct 18 18:44:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:53.743957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6207a2-4eb0-49a2-9d73-941a8e904cfa None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:53.744240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6207a2-4eb0-49a2-9d73-941a8e904cfa None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:53.744537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6207a2-4eb0-49a2-9d73-941a8e904cfa None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:53.746251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 737/1480] 10.222.0.36 () {54 vars in 962 bytes} [Mon Oct 18 18:44:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:44:53.751453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcb50-a76b-4751-ae09-db9d7b5fb7d0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:53.751725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcb50-a76b-4751-ae09-db9d7b5fb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:53.752005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcb50-a76b-4751-ae09-db9d7b5fb7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:53.771556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-eacdcb50-a76b-4751-ae09-db9d7b5fb7d0 None None] MFA Rules not processed for user `c48e090bca024c92a9cf7c038d225777`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:44:53.772738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-eacdcb50-a76b-4751-ae09-db9d7b5fb7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:44:53.779678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 744/1481] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Oct 18 18:44:53 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:44:53.787503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6207a2-4eb0-49a2-9d73-941a8e904cfa None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:44:53.797674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6207a2-4eb0-49a2-9d73-941a8e904cfa None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:44:53.801194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:44:53.801809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:44:53.802091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:44:53.802362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:44:53.810921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:44:53.812343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a6c69-4472-49d8-9df7-5745f5cf5670 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:44:53.821308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 738/1482] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:44:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:13.610604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.612080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.612812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.632160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:13.633464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:13.648223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 745/1483] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:13.657797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.658332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.658332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.682942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:13.684349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:13.698584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 739/1484] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:13.703310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:13.713739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918d96f-d632-4dd4-a0fa-15c4c9aa4715 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:13.722517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:13.723208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.723485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.723758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.724499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:13.724802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:13.726402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6369-0e23-452c-ab6f-815a7567572f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:13.739652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 746/1485] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:13.747710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:13.757430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a17a-d545-470d-bd1a-672cb964ab05 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:13.765097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:13.765755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.766031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.766301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.767043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:13.768942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:13.790027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191aaa8-7197-4789-a4f8-74a192e19d8f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.790385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191aaa8-7197-4789-a4f8-74a192e19d8f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.790636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191aaa8-7197-4789-a4f8-74a192e19d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.820282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a191aaa8-7197-4789-a4f8-74a192e19d8f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:13.821457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a191aaa8-7197-4789-a4f8-74a192e19d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:13.828703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 740/1486] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:13.851713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:13.915210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 747/1487] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:13.924918 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.925738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.926257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.951044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:13.952646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:13.954572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3afb-6a61-42d8-8792-ce6c089d94f1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:13.970935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 748/1488] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:13.971245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:13.971997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.972388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:13.972738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:13.973461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:13.975431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:13.976109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:13.985869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d896902-427c-4c6f-9f49-8ffc5e0fbf0d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:13.998533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:13.999433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:13.999965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.000234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.001762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.002209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.004105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.024736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 749/1489] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:46:14.030650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 741/1490] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:13 2021] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.034588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.034737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.045323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62198-a3c1-486f-83d4-9e1f5917491b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.051018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25de60-e3d8-445e-bfef-243fe27d1fb1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.058758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.059545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.059828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.060106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.060898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.062777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7bad-4e3f-40d1-a2bb-e03195f73290 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.067277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.067936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.068216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.068485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.069501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.071414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.079404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 750/1491] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:14.080917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.081203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.081477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.113463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.114977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.125328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 742/1492] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.126562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.129166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 751/1493] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.135579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.145037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f873bc-4d0e-4bf6-99b4-091b439715ba None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.220946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.221539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.222785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.223087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.223795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.225718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9e978-03fc-4a37-bb95-e1c8ab206cc1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.250355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ffd54-9e51-4432-b8a6-64bd34b29060 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.260143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 752/1494] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:46:14.260143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6176-c9f3-4341-8438-f8739713aad8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.260433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.260549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6176-c9f3-4341-8438-f8739713aad8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.260549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f6176-c9f3-4341-8438-f8739713aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.260708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.261429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.261429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.262267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.263676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2d313-4d50-4da3-9bbb-5f62a73280ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.274970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 743/1495] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:14.282573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2fb5-cb92-4837-85aa-424f06f43115 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.282573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2fb5-cb92-4837-85aa-424f06f43115 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.282573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2fb5-cb92-4837-85aa-424f06f43115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.283043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-db7f6176-c9f3-4341-8438-f8739713aad8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.284544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-db7f6176-c9f3-4341-8438-f8739713aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.295616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 753/1496] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.297752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a573e8-5a28-416f-8513-d9a23f9f1f66 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.298041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a573e8-5a28-416f-8513-d9a23f9f1f66 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.298320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a573e8-5a28-416f-8513-d9a23f9f1f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.302975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-726c2fb5-cb92-4837-85aa-424f06f43115 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.304960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-726c2fb5-cb92-4837-85aa-424f06f43115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.313096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 744/1497] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.314331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.314633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.314914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.316173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f8a573e8-5a28-416f-8513-d9a23f9f1f66 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.317422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f8a573e8-5a28-416f-8513-d9a23f9f1f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.325450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 754/1498] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.328153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.328566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.328973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.332558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.333743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.342079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 745/1499] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.342889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.351582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.352042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4de4-1199-4407-b243-2f406611b7ee None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.352820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.357118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.357762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.358039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.358308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.359075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.360648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97680cdf-bef0-4811-80e9-0b12c3b44904 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.361719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 755/1500] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.362535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.371345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 746/1501] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:14.372159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1bbc-36c7-4eba-b47e-b37dfc8d0431 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.372665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.373217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.373537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.377628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.378486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.378791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.379066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] PATH_INFO: `/v3/projects/f2743289049242c6ac65ceb2d6d7587f/users/1f8185f2b50349a1b5217f1009bac300/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.391017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.392201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.393143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2743289049242c6ac65ceb2d6d7587f, user_id=1f8185f2b50349a1b5217f1009bac300, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.395855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6626e52-a11c-4adc-a6bf-e00eb7d8454d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.400284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 747/1502] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.401586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.411983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574452-842d-4827-b056-f3f9d761fea1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.415576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 756/1503] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:14 2021] PUT /identity/v3/projects/f2743289049242c6ac65ceb2d6d7587f/users/1f8185f2b50349a1b5217f1009bac300/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:14.417612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537196-b635-44c4-a815-2b17b3431d52 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.417612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537196-b635-44c4-a815-2b17b3431d52 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.417866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537196-b635-44c4-a815-2b17b3431d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.435710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9f537196-b635-44c4-a815-2b17b3431d52 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.436929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9f537196-b635-44c4-a815-2b17b3431d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.466202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.466891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.467174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.467454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.468217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.468522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.470179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279f8e-f263-4e03-b056-bb7eca05aeec admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.482029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 748/1504] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.483235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399281-d66e-4707-9d8d-20ff2de579aa None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.483520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399281-d66e-4707-9d8d-20ff2de579aa None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.483803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d399281-d66e-4707-9d8d-20ff2de579aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.494179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 757/1505] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.495527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366c90-664e-4732-b692-c8120230d245 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.495817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366c90-664e-4732-b692-c8120230d245 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.496095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366c90-664e-4732-b692-c8120230d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.505567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2d399281-d66e-4707-9d8d-20ff2de579aa None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.506808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2d399281-d66e-4707-9d8d-20ff2de579aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.513435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-27366c90-664e-4732-b692-c8120230d245 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.514645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-27366c90-664e-4732-b692-c8120230d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.514975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 749/1506] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.518894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee912-7fb8-4826-94af-106be05fa52b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.518894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee912-7fb8-4826-94af-106be05fa52b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.518894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee912-7fb8-4826-94af-106be05fa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.524845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 758/1507] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.525631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27366c90-664e-4732-b692-c8120230d245 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.535808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a87ee912-7fb8-4826-94af-106be05fa52b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.535966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27366c90-664e-4732-b692-c8120230d245 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.536986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a87ee912-7fb8-4826-94af-106be05fa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.540412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.541055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.541402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.542189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.542963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.544564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a148f-349c-4a56-8762-ca0409245906 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.545231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 750/1508] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.546598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.546716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.546998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.557818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 759/1509] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:14.557818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.557818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.557818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.563806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.564971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.572689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 751/1510] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.573578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.582517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882d30c-69c2-4500-a4fe-aff157fed5bc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.584782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] MFA Rules not processed for user `1f8185f2b50349a1b5217f1009bac300`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:14.585968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:14.587087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.587784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.588124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.588938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.589632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.591564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.616536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 752/1511] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.617246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.649552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 760/1512] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:14.650609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.660313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e356ba6-c46d-4f52-acf0-718410c699ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.683406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23825-a5c4-4aa0-8d52-da54b5d26c14 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.688242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.688895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.689171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.689444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.690173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.690478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.692137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.703122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 753/1513] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.703913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.713288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff116d29-809a-419b-818d-72d7582bd5eb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.714571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.715312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.715662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.716001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.716826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.717197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.718057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.718721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.719001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.719274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.719369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.719991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.720293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.721840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.738367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 761/1514] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.738367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.738670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 754/1515] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.738670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.748234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d8e0-e6b6-459e-bb18-533cbad45814 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.748405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2bc08-93c1-4c67-bd38-8262460f87e4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.752954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.753102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.753592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.753824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.753931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.754098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.754195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.754365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] PATH_INFO: `/v3/projects/dc823e02a9644b6fbac6ff4758ce4660/users/d6485150f2824de2ae86b24ffd96fb78/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.755000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.755310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.756872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.768309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc823e02a9644b6fbac6ff4758ce4660, user_id=d6485150f2824de2ae86b24ffd96fb78, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.768743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 762/1516] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.769413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.771078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.779268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05203429-c174-451b-8e59-ce7887b60b18 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.785339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 755/1517] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:14 2021] PUT /identity/v3/projects/dc823e02a9644b6fbac6ff4758ce4660/users/d6485150f2824de2ae86b24ffd96fb78/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:14.786190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.832398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.833137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.833422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.833698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.834427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:14.834764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.836381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.844782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f286a2-40f0-4c53-b5dd-2d9afa6629bc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.849958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 763/1518] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:14.849958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.852038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.852763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.853128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.853454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.854807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.856785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.863830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f36ab-f0a4-4128-8881-0f0f3a395912 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.869070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.870328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.870538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.870842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.871560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.873454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.877365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 756/1519] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.878214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.887911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2c982-fa27-4076-bede-bcef1de6101a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.892876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.893589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.893870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.894142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.895063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.896981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:14.901346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 764/1520] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.903411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.923399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 757/1521] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:14.924362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:14.966202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fcb2b-1723-45bf-9497-f7d514dbc1be admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.982085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed682e-4ed4-4724-96ce-f1059377c720 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:14.986797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:14.987448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:14.987985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:14.988451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:14.989096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:14.991027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.016296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 758/1522] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.017152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.024544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.025194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.025499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.026273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.027029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.029057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fd243-41e7-45eb-b96b-ad3e8542ce50 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.053217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 765/1523] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:14 2021] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.054625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.054977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.055323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.072452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:15.073813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:15.075786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4c311-c800-45c1-93b0-0bac725b260f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.128115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.128766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.129043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.129313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.130008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.130399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 766/1524] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:15.131226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.131919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.140200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7499e-71fb-4c6a-85d8-7c53636d48fb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.144928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.145590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.145870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.146184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.147063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.149154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.161034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 759/1525] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.161034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.175863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 767/1526] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.176945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.218030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45001-5f1f-4718-bc51-997d7ede4ff5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.234861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771cb28-b12a-4edd-a8ea-8ac9430b955b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.239462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.240043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.240321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.240591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.241281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.243220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.264947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 768/1527] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.265721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.272238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.272904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.273182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.273453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.274192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.274710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf13c2-65d6-431b-b25b-06391745f106 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.275876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.279172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.279792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.280067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.280333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.281015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.282913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.285559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 760/1528] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.286110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.295473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e0824-5a8f-40a9-9f85-2c715efc8a46 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.300725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.301523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.301875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.302213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.303031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.308507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 769/1529] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.308652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.308774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.315338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d52c3-da1b-48ed-9ec7-e805cacc39bc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.320866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.321518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.321799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.322080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.322849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.324752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.325184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 761/1530] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.328572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.347531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 770/1531] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 281 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.347531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.355123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19994645-1c73-4675-a271-f08e3ccc0ed6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.359706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.360327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.360602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.360873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.361550 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.363461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.380627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18734-2e00-4e76-b6fd-4d4718f6efd9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.383566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 771/1532] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.384369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.384521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.385028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.385310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.385580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.394454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.394888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f38f8-d202-4856-b3f2-c98075e0d7ba admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.395908 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.399391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.400010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.400290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.400562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.401791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.403698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.405812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 762/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:15.406613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.415289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633d37-7d23-45e0-b9bc-bde880d97387 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.420516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.421171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.421472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.421716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.422443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.424062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.424880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 772/1534] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:15.425694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.435484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 763/1535] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.435911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169157d5-a35d-41f4-a1a0-b219c4d00705 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.436255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.440936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.441595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.441939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.442139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.442927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.444528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.448781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5f25-ef24-43d8-855e-79869505cf92 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.456645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.457309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.457642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.457922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.458851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.460603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.469056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 773/1536] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.469056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.474655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 764/1537] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.474655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.477698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563661-2655-4405-b450-bd8950d538b4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.482665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.483367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.483549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efa83-9768-4427-a3ff-93d730bb7709 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.483653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.483995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.484612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.486349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.489154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.489696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.489990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.490203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.490999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.492638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.498241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 774/1538] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.499001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.504869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 765/1539] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.505962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.514215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a497-9a6d-4b77-8cdb-51edd474e4ff admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.520233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.521036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.521376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.521707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.522571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.524334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.529621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1608-75ab-40aa-98ed-dded0d0d3da1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.535063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.535837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.536177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.536547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.537473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.537934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 775/1540] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.539003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.539637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.553272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 766/1541] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.553413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2331c-4b7a-4042-abf9-c40ccf79c7c8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.553516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.557856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.558903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.559249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.559585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] PATH_INFO: `/v3/projects/e05b10c0e41841e0b908562e5a79508f/users/1427de85d2ca4e798e166171652ca9f4/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.561325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4287-74b2-4787-ab09-9509fddbffb7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.566253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.567225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.567571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.567911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] PATH_INFO: `/v3/projects/8a5eba873a194327bbc6271cfbd2c116/users/da3448febf084ab285f23d38701f61d6/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.574761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05b10c0e41841e0b908562e5a79508f, user_id=1427de85d2ca4e798e166171652ca9f4, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.577477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.584853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5eba873a194327bbc6271cfbd2c116, user_id=da3448febf084ab285f23d38701f61d6, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.587878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.593702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 776/1542] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/e05b10c0e41841e0b908562e5a79508f/users/1427de85d2ca4e798e166171652ca9f4/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:15.595643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.605321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 767/1543] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/8a5eba873a194327bbc6271cfbd2c116/users/da3448febf084ab285f23d38701f61d6/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:15.605321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.676088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584f89-43c2-4dae-a7fa-849313fb8d85 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.678999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda191c0-2202-4bb4-b834-c091031468bb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.681688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.682695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.683044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.683319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.684059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.684656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.685328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.685664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.685841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.686121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.686928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.688823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.696215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 768/1544] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.699839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 777/1545] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.700998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.701222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.710564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781529-e7f2-48e2-a6f8-0686ff18d439 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.710966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a803-1392-4170-a0e4-01602ddfe5d1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.715790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.716470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.716914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.717129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.717245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.717534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.717654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.717936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.718385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.718707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.720197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.720410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.731362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 769/1546] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.731551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 778/1547] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.735530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.738588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.747025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a631-abc9-4252-b45c-1091bb4474dc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.751704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809a2e-ebe1-40be-8ea0-0ab164ca5323 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.753235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.753738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.754018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.754293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.755071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.756813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158e54d-7632-4be2-850f-9525cca4f810 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.756945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.757600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.757885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.758164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.758949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.761202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.768758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 770/1548] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.769994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.770282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.770576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.773794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 779/1549] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:15 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:15.774728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.792117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9186f-8546-4816-8c1c-71664f122434 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.797127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.798208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.798683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.799130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] PATH_INFO: `/v3/projects/3a9d946d10724a739e45769fb83f2a7b/users/a89417ea7c7442289745cb1851eccaa4/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.804964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] MFA Rules not processed for user `da3448febf084ab285f23d38701f61d6`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:15.806674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:15.816926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9d946d10724a739e45769fb83f2a7b, user_id=a89417ea7c7442289745cb1851eccaa4, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.819863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.838251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 780/1550] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/3a9d946d10724a739e45769fb83f2a7b/users/a89417ea7c7442289745cb1851eccaa4/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:15.839600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.893583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 771/1551] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:15 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:15.894406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.909465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765cfe9-52f1-490c-b7e1-89182981934b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.913240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee45-aa0b-4c65-8b29-09c5373b65c4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:15.915040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.915918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.916348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.916623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] PATH_INFO: `/v3/projects/e183b82bf2534a70a0032124032e2fc9/users/5d8d695f90c546aeab8f5181c8237d40/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.918984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:15.919891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:15.920229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:15.920490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] PATH_INFO: `/v3/projects/d2ca83134dcd40a7887485fcf5bca190/users/4e5f42f158884a78bc8223e3480eee08/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:15.933450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e183b82bf2534a70a0032124032e2fc9, user_id=5d8d695f90c546aeab8f5181c8237d40, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.935558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ca83134dcd40a7887485fcf5bca190, user_id=4e5f42f158884a78bc8223e3480eee08, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:15.936773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.938200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:15.952649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 772/1552] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/e183b82bf2534a70a0032124032e2fc9/users/5d8d695f90c546aeab8f5181c8237d40/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:15.962046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:15.962167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 781/1553] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/d2ca83134dcd40a7887485fcf5bca190/users/4e5f42f158884a78bc8223e3480eee08/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:15.962167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.023312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce93250-bfac-4080-bbd1-ff350bf7fd53 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.024600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475487-357f-431a-addc-9a3358cb7486 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.028470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.029539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.029772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.030209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.030678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.030814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] PATH_INFO: `/v3/projects/ec4a5db3d42249da8b022afd8be07046/users/1c138baba41541c39039712e69b71c50/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.030938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.031213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] PATH_INFO: `/v3/projects/9963cc9c643f4a5785f2cde5af79fd00/users/0354a07d8de14ad4b2a90b5e0b9de8f4/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.046144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9963cc9c643f4a5785f2cde5af79fd00, user_id=0354a07d8de14ad4b2a90b5e0b9de8f4, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.047409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4a5db3d42249da8b022afd8be07046, user_id=1c138baba41541c39039712e69b71c50, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.048844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.050621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282522db-abd1-494d-bdb0-106f257b5b94 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.062509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 782/1554] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/9963cc9c643f4a5785f2cde5af79fd00/users/0354a07d8de14ad4b2a90b5e0b9de8f4/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:16.063335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.085940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 773/1555] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:15 2021] PUT /identity/v3/projects/ec4a5db3d42249da8b022afd8be07046/users/1c138baba41541c39039712e69b71c50/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:16.085940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.085940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.085940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.117768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.119097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.138405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ed9c-48ee-4800-87ca-c20c20901560 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.192495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 774/1556] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.195911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.203162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.204929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.205535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.206023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] PATH_INFO: `/v3/projects/e05b10c0e41841e0b908562e5a79508f/users/1427de85d2ca4e798e166171652ca9f4/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.208920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05b10c0e41841e0b908562e5a79508f, user_id=1427de85d2ca4e798e166171652ca9f4, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.212088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a4af1-8cdb-4069-95fd-4b4985699d05 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.223901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 783/1557] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:16 2021] PUT /identity/v3/projects/e05b10c0e41841e0b908562e5a79508f/users/1427de85d2ca4e798e166171652ca9f4/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:16.225241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78123501-5512-466c-8576-1c755a0416c9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.225587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78123501-5512-466c-8576-1c755a0416c9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.225922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78123501-5512-466c-8576-1c755a0416c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.259818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-78123501-5512-466c-8576-1c755a0416c9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.261941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-78123501-5512-466c-8576-1c755a0416c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.275536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fc589-9b39-48a0-a2c7-50d971a54dff None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.332638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.333442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.333729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.334006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.341613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 784/1558] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.343312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.343692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.344511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.376603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] MFA Rules not processed for user `5d8d695f90c546aeab8f5181c8237d40`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.377961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.395443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.397372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e5943-1531-4f82-aa79-9e29332b4a19 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.407982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 775/1559] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:16 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:16.409776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3947-9bd8-40ef-938b-b88cec7bb781 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.410090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3947-9bd8-40ef-938b-b88cec7bb781 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.410373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3947-9bd8-40ef-938b-b88cec7bb781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.430794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-620f3947-9bd8-40ef-938b-b88cec7bb781 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.433159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-620f3947-9bd8-40ef-938b-b88cec7bb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.449474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 776/1560] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.449474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.449474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.449474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.464502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 785/1561] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.465518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.466968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.487213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] MFA Rules not processed for user `1c138baba41541c39039712e69b71c50`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.488491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.552470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f789-bafd-49c8-aa2d-f91d2cd8b6e6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.558743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.559124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.559459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.559741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.571365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.573163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f0673-8466-4223-9f66-5638cc226dd6 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.596709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 786/1562] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:16.600354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d753dd-8e72-4bf2-b7da-dc68371085ad None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.600521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d753dd-8e72-4bf2-b7da-dc68371085ad None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.600780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d753dd-8e72-4bf2-b7da-dc68371085ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.616727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 777/1563] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.623224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.642980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034587-9f50-4e0c-aa46-a19f6c2db3a1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.653347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.654344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.655566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.655851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.683974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-42d753dd-8e72-4bf2-b7da-dc68371085ad None None] MFA Rules not processed for user `1427de85d2ca4e798e166171652ca9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.687538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-42d753dd-8e72-4bf2-b7da-dc68371085ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.692767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.695653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.727237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 778/1564] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:16.730104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.748516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939f34-fa7f-43db-8b37-32c1a4851b94 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.761300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.762629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.764459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.765073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.790340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.795890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.815602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 779/1565] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:16.817691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:16.842057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698a53-44f3-4dba-86fb-fee85a48067a service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:16.847784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 787/1566] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:16.849490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46752fb-6334-4112-9ca3-611732ade460 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.849777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46752fb-6334-4112-9ca3-611732ade460 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.850056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46752fb-6334-4112-9ca3-611732ade460 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.852210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 788/1567] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:46:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:46:16.855962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:16.856768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.857054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.857326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.858264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:16.860265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:16.860499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:16.860778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:16.864363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:16.899410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:16.901352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:16.920087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 780/1568] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:16.921345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.050963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca3-66bf-4564-bbfd-60c8d2d67a7c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.056569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.059424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.059989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.060114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.070204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 789/1569] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:46:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:17.075066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.101998 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0b3b-cf73-44bb-9759-95cfe1b287fe None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.216226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.217978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.253267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 781/1570] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:16 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:17.256281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.280636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.285669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.286116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.286406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.288546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.299391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.344564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 790/1571] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:17 2021] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:17.348470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.376978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091afa-fc91-4ab2-ab69-bbfc6be45fa1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.382339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.383146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.383495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.384481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.385018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.386666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.412874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 791/1572] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:17 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:17.412874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.428298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d0fc-7ac3-4a1f-8e20-d254a86f1c5b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.442671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.443568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.443848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.444120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] PATH_INFO: `/v3/projects/ccb65b9ead064d6685226ecbb0d626f6/users/e18c58d6c4df45a7917558a29f0f54b6/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.482105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb65b9ead064d6685226ecbb0d626f6, user_id=e18c58d6c4df45a7917558a29f0f54b6, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.485036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.504719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb34a-c112-4784-990a-996f2e2dc1ee service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.516634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 792/1573] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:17 2021] PUT /identity/v3/projects/ccb65b9ead064d6685226ecbb0d626f6/users/e18c58d6c4df45a7917558a29f0f54b6/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:17.519214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.527441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.528134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.528624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.528904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.630309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61d3a-eaa2-4ad8-969c-600cfe4f2126 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.640433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.643641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.644358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.644637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.644905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.645837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.669816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 782/1574] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:17 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:17.670783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.700345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127da93f-d536-495d-858f-ec579e861cc0 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.739061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.741221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.772225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 793/1575] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:17 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:17.846739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.847883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.848815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.852672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.879698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.888131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51a8d-1916-443f-bd92-719c9d91a845 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:17.905067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 783/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:17 2021] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:17.910138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:17.930436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f99e48-e689-4328-82ae-61703e8f3c46 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:17.954834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:17.955871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:17.956864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:17.957150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] PATH_INFO: `/v3/projects/ccb65b9ead064d6685226ecbb0d626f6/users/e18c58d6c4df45a7917558a29f0f54b6/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:17.963836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb65b9ead064d6685226ecbb0d626f6, user_id=e18c58d6c4df45a7917558a29f0f54b6, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:17.970792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bbcf4-bac8-4148-a1a5-31889f1bc4bb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:18.013971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 794/1577] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:17 2021] PUT /identity/v3/projects/ccb65b9ead064d6685226ecbb0d626f6/users/e18c58d6c4df45a7917558a29f0f54b6/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:18.027494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.027784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.028060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.087556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] MFA Rules not processed for user `e18c58d6c4df45a7917558a29f0f54b6`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:18.088923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:18.169956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6783-01f4-4df3-8798-547d18186a4c None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.170472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6783-01f4-4df3-8798-547d18186a4c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.170944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6783-01f4-4df3-8798-547d18186a4c None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.172942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 795/1578] 10.222.0.36 () {54 vars in 912 bytes} [Mon Oct 18 18:46:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:46:18.199189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acef803-ad4e-41e8-8027-bfefb53f5026 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.200847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acef803-ad4e-41e8-8027-bfefb53f5026 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.201786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acef803-ad4e-41e8-8027-bfefb53f5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.286201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0acef803-ad4e-41e8-8027-bfefb53f5026 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:18.289978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0acef803-ad4e-41e8-8027-bfefb53f5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:18.290766 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 784/1579] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:18 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:18.307676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:18.457209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679568a-a1bf-46ca-9fe1-0331c82d6d29 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:18.462057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:18.464480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.464480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.464884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.479833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:18.481563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:18.511127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 785/1580] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:18 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:18.588783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 796/1581] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:46:18 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:18.605258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:18.620507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035901-744b-4460-8a86-bf6b29c7346c service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:18.632855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:18.633531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.633819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.634101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.658238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:18.661668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:18.699646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 786/1582] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:18.807501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3e40-a405-4694-a648-48d9accd6d78 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.808028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3e40-a405-4694-a648-48d9accd6d78 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.808442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3e40-a405-4694-a648-48d9accd6d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.821501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:18.872341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-596e3e40-a405-4694-a648-48d9accd6d78 None None] MFA Rules not processed for user `a89417ea7c7442289745cb1851eccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:18.874078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-596e3e40-a405-4694-a648-48d9accd6d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:18.953427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ab0a-b9bf-4c5c-9700-27dce8db7e76 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:18.978247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:18.983112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:18.984549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:18.984894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] PATH_INFO: `/v3/users/5d8d695f90c546aeab8f5181c8237d40` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:18.987827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8d695f90c546aeab8f5181c8237d40)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:18.991323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:19.028858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 797/1583] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:18 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.031428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2468-a419-4b39-92ca-99a4cca6ed74 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.031829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2468-a419-4b39-92ca-99a4cca6ed74 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.032203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2468-a419-4b39-92ca-99a4cca6ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.104741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8add2468-a419-4b39-92ca-99a4cca6ed74 None None] MFA Rules not processed for user `a89417ea7c7442289745cb1851eccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:19.106526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8add2468-a419-4b39-92ca-99a4cca6ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.140649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 798/1584] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:19 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.142195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a27a-6e0b-44ae-ad36-ef45d0975407 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.143361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a27a-6e0b-44ae-ad36-ef45d0975407 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.143992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a27a-6e0b-44ae-ad36-ef45d0975407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.144799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8d695f90c546aeab8f5181c8237d40'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:19.172880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8d695f90c546aeab8f5181c8237d40'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:19.187282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8d695f90c546aeab8f5181c8237d40'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:19.188721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8d695f90c546aeab8f5181c8237d40'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:19.191118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-037fae61-dcf0-4a36-89b7-b78bdf06ed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8d695f90c546aeab8f5181c8237d40'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:19.204342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5c59a27a-6e0b-44ae-ad36-ef45d0975407 None None] MFA Rules not processed for user `4e5f42f158884a78bc8223e3480eee08`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:19.205678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5c59a27a-6e0b-44ae-ad36-ef45d0975407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.219339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 787/1585] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:18 2021] DELETE /identity/v3/users/5d8d695f90c546aeab8f5181c8237d40 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:19.226219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe96c-e1d7-47e4-bbc0-400ff6efbf5b None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.228048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe96c-e1d7-47e4-bbc0-400ff6efbf5b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.228048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe96c-e1d7-47e4-bbc0-400ff6efbf5b None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.231546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 788/1586] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:46:19 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:46:19.235971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c151-fd11-45ea-845f-94020d7eb5dd None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.236684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c151-fd11-45ea-845f-94020d7eb5dd None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.248412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c151-fd11-45ea-845f-94020d7eb5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.293213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4fa4c151-fd11-45ea-845f-94020d7eb5dd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:19.296791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4fa4c151-fd11-45ea-845f-94020d7eb5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.398816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 799/1587] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.398816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.398816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.398816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.437841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:19.449099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.469749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 789/1588] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.471517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.472851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.473272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.537831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] MFA Rules not processed for user `4e5f42f158884a78bc8223e3480eee08`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:19.539913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.630623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 800/1589] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:46:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.633175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:19.641721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.751770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 790/1590] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:19.751770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:19.835449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d0900-2ddd-4403-ad6a-cac44862f07e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:19.843354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d7ab-31aa-4d1c-a0c6-06d49cde18d4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:19.846084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:19.847309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.847695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.848829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.850491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.854026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:19.854947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.856209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.857491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:19.886484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:19.889252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:19.914793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 801/1591] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:19.917255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:19.920749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:19.928376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:19.930402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52037dc-63d1-40b0-90bf-3df2faa9f313 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:19.944476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 791/1592] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:19 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:19.963777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ccab5-9b33-41b0-8484-d6e9b745028f service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:19.983916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:19.983916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:19.983916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:19.983916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:20.002906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:20.008068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46966b-83af-48df-a850-a93c5276f2fd service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:20.036226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 802/1593] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:19 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:20.755227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:20.755580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:20.755782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:20.757635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 792/1594] 10.222.0.36 () {54 vars in 912 bytes} [Mon Oct 18 18:46:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:46:20.768659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf1d0-4b01-418d-b845-7585434c00d3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:20.768945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf1d0-4b01-418d-b845-7585434c00d3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:20.769225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf1d0-4b01-418d-b845-7585434c00d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:20.808069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1d3cf1d0-4b01-418d-b845-7585434c00d3 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:20.811517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1d3cf1d0-4b01-418d-b845-7585434c00d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:20.837064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 803/1595] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:46:20 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:20.854162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:20.860718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.017141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1160a9-952b-4fbc-9ce4-cf14b21f25db None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:21.026282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:21.026988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.027322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.027613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.053808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:21.057678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a6843-5509-4db8-b525-7eb91bdb463d service glance] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:21.086836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 793/1596] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:21.096239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.097755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.098662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.101495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 804/1597] 10.222.0.36 () {54 vars in 912 bytes} [Mon Oct 18 18:46:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:46:21.110518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.111063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.111541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.202056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:21.203272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.218026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 794/1598] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:46:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:21.243885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:21.247863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.270036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564368b-810c-42e4-9b9f-3c9c754396a5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:21.285301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:21.286533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.288309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.288768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.302210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:21.308262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae074-cf6a-4074-afd7-164ad4c44a4f service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:21.317547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 805/1599] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:21.610791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:21.612259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.622908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea19-437d-4c4a-bb4f-39d443521ed4 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.623710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea19-437d-4c4a-bb4f-39d443521ed4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.624320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eea19-437d-4c4a-bb4f-39d443521ed4 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.627099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 806/1600] 10.222.0.36 () {54 vars in 912 bytes} [Mon Oct 18 18:46:21 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 18:46:21.634882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.636987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.637476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.637603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67cd0-2950-4511-872e-a4c758db92b9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:21.648937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:21.649815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.650102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.650382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] PATH_INFO: `/v3/projects/e183b82bf2534a70a0032124032e2fc9` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.659762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e183b82bf2534a70a0032124032e2fc9)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:21.660528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: WARNING py.warnings [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:46:21.660528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: warnings.warn(msg) Oct 18 18:46:21.660528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: Oct 18 18:46:21.661761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:21.684300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:21.685936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.705462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 807/1601] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:46:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:21.747619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:21.757360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20777-29a5-49c9-8c1d-e12f1339d1ab None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:21.783782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e183b82bf2534a70a0032124032e2fc9', 'request_id': 'req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:21.793734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e183b82bf2534a70a0032124032e2fc9', 'request_id': 'req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:21.813857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e183b82bf2534a70a0032124032e2fc9', 'request_id': 'req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:21.839520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] The token cache is being invalidate because project e183b82bf2534a70a0032124032e2fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:21.840974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:21.841957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:21.844181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 795/1602] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:21 2021] DELETE /identity/v3/projects/e183b82bf2534a70a0032124032e2fc9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:21.850017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:21.860325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.887633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:21.888285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:21.890507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:21.891584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:21.897079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:21.926141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:21.927789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:21.975208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 808/1603] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:21.993919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f55c-bb6b-4d6d-ba0a-9cdb37d7b184 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:22.014808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:22.015706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:22.015990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:22.022053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] PATH_INFO: `/v3/users/e18c58d6c4df45a7917558a29f0f54b6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:22.025293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18c58d6c4df45a7917558a29f0f54b6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:22.036440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:22.144995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18c58d6c4df45a7917558a29f0f54b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:22.167826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18c58d6c4df45a7917558a29f0f54b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:22.176470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18c58d6c4df45a7917558a29f0f54b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:22.177303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18c58d6c4df45a7917558a29f0f54b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:22.177960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18c58d6c4df45a7917558a29f0f54b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:22.198577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 796/1604] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:21 2021] DELETE /identity/v3/users/e18c58d6c4df45a7917558a29f0f54b6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:22.356018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:22.358199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:22.535881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472894e-a3c4-47a3-9981-34ef798136bf service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:22.758029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:22.758653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:22.758911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:22.759182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:22.770901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:22.801986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:22.810008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f29fa-a8bc-4061-9623-891fc34f125e service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:22.842607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 809/1605] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:22 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:23.626814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:23.628824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:23.839164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fbcd-23d3-46f2-823c-45e3bd16c01c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:23.859436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:23.860339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:23.860618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:23.860892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] PATH_INFO: `/v3/projects/ccb65b9ead064d6685226ecbb0d626f6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:23.863315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb65b9ead064d6685226ecbb0d626f6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:23.866534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:23.989431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb65b9ead064d6685226ecbb0d626f6', 'request_id': 'req-ce482725-eabf-4ca7-a62b-ed24b962a5bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:24.009372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb65b9ead064d6685226ecbb0d626f6', 'request_id': 'req-ce482725-eabf-4ca7-a62b-ed24b962a5bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:24.022937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb65b9ead064d6685226ecbb0d626f6', 'request_id': 'req-ce482725-eabf-4ca7-a62b-ed24b962a5bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:24.047688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] The token cache is being invalidate because project ccb65b9ead064d6685226ecbb0d626f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:24.048003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:24.048637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ce482725-eabf-4ca7-a62b-ed24b962a5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:24.050601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 797/1606] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:23 2021] DELETE /identity/v3/projects/ccb65b9ead064d6685226ecbb0d626f6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:24.056469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e32eb-14bf-48e5-b6e8-a4823375ceb9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.057937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e32eb-14bf-48e5-b6e8-a4823375ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.058373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e32eb-14bf-48e5-b6e8-a4823375ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.090349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-301e32eb-14bf-48e5-b6e8-a4823375ceb9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:24.092638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-301e32eb-14bf-48e5-b6e8-a4823375ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:24.196393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.196736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.197012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.256632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] MFA Rules not processed for user `d6485150f2824de2ae86b24ffd96fb78`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:24.262502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:24.343244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 810/1607] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:24.344935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.347346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.348023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.385166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:24.386808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:24.421960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 811/1608] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:24.424789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.451102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64bd04-64f6-4d2a-a78e-e7d06e0af864 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.477077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 798/1609] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:24 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:24.482098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.482098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.482098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.491532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.492272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.493058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:24.493184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:24.495096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.498232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.534321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 812/1610] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:24.535747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.560119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafbdca-4c0a-4906-bbee-caf770e1cedf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.570582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.571958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.573248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.573706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.576332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.580920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.599784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c386b-d78d-4771-9c73-18c6ff0ecc47 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.619519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.620902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.621493 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.621795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.636539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.639886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.650218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 799/1611] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:24 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:24.655638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.664141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 813/1612] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:24 2021] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:24.676174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa4896-af21-464f-a482-03a82c39c53c service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.799329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.800266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.800709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.801135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.801993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.804755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.841554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.850156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 800/1613] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:24 2021] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:24.855653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbeda4-9228-490c-985f-87441e8cd6ec admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.864908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.866125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.866672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.867149 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.868102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.869949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.886965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 814/1614] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:24 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:24.887264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.900308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e597d-8a1c-4ad5-836f-5c57a4ae239c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.914923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.915603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.915890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.916726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:24.917478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:24.920520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269769d-7616-4025-973e-868ca53372d1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:24.933743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 801/1615] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:24 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:24.935139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:24.949524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078bd5b-e2ab-47c3-985f-02c86b827312 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:24.963914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:24.964968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:24.965359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:24.965739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] PATH_INFO: `/v3/projects/f4e6b312330a4ba68a11b4c84a9ca089/users/1606827d14854cf5ae735804ed5cea82/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.011043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e6b312330a4ba68a11b4c84a9ca089, user_id=1606827d14854cf5ae735804ed5cea82, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.016968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.061633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 815/1616] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:24 2021] PUT /identity/v3/projects/f4e6b312330a4ba68a11b4c84a9ca089/users/1606827d14854cf5ae735804ed5cea82/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:25.064468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.064941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.065276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.120577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] MFA Rules not processed for user `1606827d14854cf5ae735804ed5cea82`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:25.121948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:25.253856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 802/1617] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:25 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:25.258443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:25.336771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7857fa-a7c2-45f3-9f9a-e982986bdb8e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:25.342447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:25.343162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.343444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.343781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.344497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.346539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.393732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:25.401939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 816/1618] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:25 2021] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:25.414965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687911-df17-4419-94c2-f0358093ae5b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:25.546999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:25.548584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.548877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.549150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.549867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.551828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.590366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:25.591330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 803/1619] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:25 2021] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:25.605624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e318-c81c-41f2-862a-13ee13c29b45 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:25.617335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:25.620165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.620447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.620723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.621828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.623548 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.657099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 817/1620] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:25 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:25.661599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:25.675157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003f7b-8367-4392-8ca0-1ecfeb2036ba admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:25.685625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:25.686736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.687278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.688041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.689114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.691153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cecc-d933-426e-8366-cceaeea37504 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.704594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 804/1621] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:25 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:25.708501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:25.719583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257567-83db-4ba3-b5f8-d83aa2d5c7f2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:25.726963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:25.728736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.729119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.729545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] PATH_INFO: `/v3/projects/84fced3e5f1f40a79b36b6363028b6b5/users/c90176f54b2b42c0b1aa33780a559b16/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.755995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fced3e5f1f40a79b36b6363028b6b5, user_id=c90176f54b2b42c0b1aa33780a559b16, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:25.761786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:25.794583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 818/1622] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:25 2021] PUT /identity/v3/projects/84fced3e5f1f40a79b36b6363028b6b5/users/c90176f54b2b42c0b1aa33780a559b16/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:25.841095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:25.842528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:25.843066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:25.895266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] MFA Rules not processed for user `c90176f54b2b42c0b1aa33780a559b16`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:25.897268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:25.981581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 805/1623] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:25 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:25.992120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.102396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c165b-bb6a-41a0-a1c6-d8b861314f94 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.115322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.116816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.117617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.118107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.119054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.121910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.181675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 819/1624] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:25 2021] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:26.187106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.203856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a592-2a94-4cbb-9dda-d293ca412069 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.349224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.349865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.350233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.350410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.351158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.353410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.387455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 806/1625] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:26 2021] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:26.387976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.401082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb01f-8d70-46ec-acef-54b175fac129 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.408459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.409207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.409709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.410177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.411536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.413551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.433701 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.456941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94c181-3745-4b6d-bfd5-a637140c78bc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.457443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 820/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:26 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:26.474382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.476233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.476586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.476931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] PATH_INFO: `/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886/users/91a70160f1d5445a867f4b8d4e1fc6ff/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.524091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d9fb2fbf6f4bfca6ff920bb128e886, user_id=91a70160f1d5445a867f4b8d4e1fc6ff, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.527545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.554462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 807/1627] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:26 2021] PUT /identity/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886/users/91a70160f1d5445a867f4b8d4e1fc6ff/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:26.558579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.571815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba95cf-e9e1-4490-b3c0-475726abb116 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.699741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.700653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.701774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.702328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.703384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.705247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12547b-d6e5-44aa-8237-57f064e30285 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.722517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 821/1628] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:26 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:26.723887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:26.748098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e028-8ce6-43e4-8dd9-7d3fc2b1ffe1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:26.772704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:26.773626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.773902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.774167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] PATH_INFO: `/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886/users/91a70160f1d5445a867f4b8d4e1fc6ff/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.778444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d9fb2fbf6f4bfca6ff920bb128e886, user_id=91a70160f1d5445a867f4b8d4e1fc6ff, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:26.781203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87f7a-2967-4cb6-a09b-d9dc2cb0e68d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:26.792751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 808/1629] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:26 2021] PUT /identity/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886/users/91a70160f1d5445a867f4b8d4e1fc6ff/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:26.802664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.802993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.803221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:26.911031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] MFA Rules not processed for user `91a70160f1d5445a867f4b8d4e1fc6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:26.912295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:26.958415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6f60-a55a-4467-9f94-f6dbc376dec0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:26.961532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6f60-a55a-4467-9f94-f6dbc376dec0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:26.964213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6f60-a55a-4467-9f94-f6dbc376dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:27.064755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-310a6f60-a55a-4467-9f94-f6dbc376dec0 None None] MFA Rules not processed for user `0354a07d8de14ad4b2a90b5e0b9de8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:27.066184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-310a6f60-a55a-4467-9f94-f6dbc376dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:27.133042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 822/1630] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:26 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:27.140529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:27.142463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:27.223829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9e30-166e-4267-9c9a-d2078fa448e5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:27.228190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:27.234163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:27.234363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:27.234647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:27.240188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 809/1631] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:26 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:27.253774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:27.254262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:27.254846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:27.256939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:27.261582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:27.272293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 823/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:27 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:27.295276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] MFA Rules not processed for user `0354a07d8de14ad4b2a90b5e0b9de8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:27.296568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:27.335948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:27.336584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 810/1633] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:27 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:27.509497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb3f98-3045-4ad1-a0c2-0c4ed82beb12 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:27.533145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:27.535889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:27.536170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:27.536607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:27.559399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:27.564205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc72f-57f0-4206-947b-d82594e92636 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:27.585931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 824/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:27 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:28.489789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:28.492272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:28.554806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296f77c-d920-491b-9c3f-e13776b85d91 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:28.569994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:28.574415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:28.575018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:28.575530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:28.622432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f36d-c605-495c-bbbb-c0edce8e635f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:28.623401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f36d-c605-495c-bbbb-c0edce8e635f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:28.623841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f36d-c605-495c-bbbb-c0edce8e635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:28.645897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ae87f36d-c605-495c-bbbb-c0edce8e635f None None] MFA Rules not processed for user `d6485150f2824de2ae86b24ffd96fb78`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:28.647711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ae87f36d-c605-495c-bbbb-c0edce8e635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:28.779931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:28.785659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:28.791755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 825/1635] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:28 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:28.825601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 811/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:28 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:28.832684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:28.833035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:28.833321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:28.903033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:28.910804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:29.107693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 826/1637] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:46:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:29.403609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:29.408147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:29.563400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632b87-ffc8-42b1-b510-5622343c4e7b service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:29.585135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:29.587418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:29.589149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:29.589637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:29.623296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:29.627502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c136e3-3920-4f0d-8668-b5d4417944e9 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:29.663958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 812/1638] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:46:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 18:46:29.926656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:29.926656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:30.129164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb07c9-fc82-4f49-a5c0-a1fddd2c45b2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:30.142096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:30.145446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:30.145684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:30.145970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] PATH_INFO: `/v3/users/1c138baba41541c39039712e69b71c50` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:30.151355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c138baba41541c39039712e69b71c50)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:30.153986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: WARNING py.warnings [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 18:46:30.153986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: warnings.warn(msg) Oct 18 18:46:30.153986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: Oct 18 18:46:30.155349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:30.347392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c138baba41541c39039712e69b71c50'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:30.372611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c138baba41541c39039712e69b71c50'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:30.395643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c138baba41541c39039712e69b71c50'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:30.437513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c138baba41541c39039712e69b71c50'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:30.439302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e61abc27-cea2-4d7a-bc42-1986c48c495e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c138baba41541c39039712e69b71c50'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:30.475253 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 827/1639] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:29 2021] DELETE /identity/v3/users/1c138baba41541c39039712e69b71c50 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:30.480127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:30.480616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:30.481039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:30.520176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:30.524186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:30.537661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:30.538808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:30.539262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:30.603507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] MFA Rules not processed for user `0354a07d8de14ad4b2a90b5e0b9de8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:30.613708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:30.759029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 813/1640] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:30.773220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 828/1641] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:30 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:30.788811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:30.791494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:31.014201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce33288-636b-4747-b411-2001aa9d7285 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:31.022719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:31.023689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:31.024172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:31.024600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:31.050709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:31.052273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e492197-8ba3-4fde-8fc2-7d77738b5b86 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:31.077107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 814/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:31.753873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:31.756817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:31.789994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bcb7-5bc3-4e69-8035-6ba4d8156563 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:31.803285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:31.807962 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:31.808319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:31.808922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] PATH_INFO: `/v3/projects/ec4a5db3d42249da8b022afd8be07046` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:31.811069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4a5db3d42249da8b022afd8be07046)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:31.817499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:31.991437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4a5db3d42249da8b022afd8be07046', 'request_id': 'req-188dd1ae-ac94-4628-9805-7d329b390ef0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:32.004993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4a5db3d42249da8b022afd8be07046', 'request_id': 'req-188dd1ae-ac94-4628-9805-7d329b390ef0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:32.027246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4a5db3d42249da8b022afd8be07046', 'request_id': 'req-188dd1ae-ac94-4628-9805-7d329b390ef0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:32.067184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] The token cache is being invalidate because project ec4a5db3d42249da8b022afd8be07046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:32.067476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:32.068154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-188dd1ae-ac94-4628-9805-7d329b390ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:32.070783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 829/1643] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:31 2021] DELETE /identity/v3/projects/ec4a5db3d42249da8b022afd8be07046 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:32.078240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.078782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.078868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.101684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:32.102937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:32.257820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 815/1644] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:32.259508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.260328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.260603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.298521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:32.303178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:32.337142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 830/1645] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:32.338468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.352275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334584-9e00-4088-a5bb-bf5e2a3801ac None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.361379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.362268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.362936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.363345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.364930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:32.365219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:32.366952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:32.407097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.418013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade6d4-b359-4416-b74d-4670eade3714 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.419062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 816/1646] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:46:32.425847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.427074 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.427367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.427654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.428364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:32.430300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:32.485742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.497826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 831/1647] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:32 2021] POST /identity/v3/projects => generated 355 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:32.502709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef6ac-2293-4f27-846b-280da9073856 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.658392 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.663404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.668015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.668336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.669143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:32.673317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:32.732520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 817/1648] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:32 2021] POST /identity/v3/users => generated 278 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:46:32.737129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.751951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68511-6827-41b2-90ff-26b0a7187088 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.759065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.767352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.769743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.770847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.773209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:32.781626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:32.805577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 832/1649] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:32 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:32.810034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.843767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fefd-02ad-4181-967c-18df34e05bbb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.855993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.856664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.856996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.857312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:32.858530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:32.864200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5094664-d641-43ec-a8a8-b1a7a0e9a4e7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:32.919724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:32.922492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 818/1650] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:32 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:32.946540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bcc0d-adc4-435d-8443-3f061b3535cf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:32.963479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:32.964379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:32.964662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:32.964966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] PATH_INFO: `/v3/projects/1b1662098f4c41578ca8ef34382e5855/users/f34efc431c7f41afb80c778e7489852f/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.024834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1662098f4c41578ca8ef34382e5855, user_id=f34efc431c7f41afb80c778e7489852f, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:33.028036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:33.062590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 833/1651] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:32 2021] PUT /identity/v3/projects/1b1662098f4c41578ca8ef34382e5855/users/f34efc431c7f41afb80c778e7489852f/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:33.074852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:33.075525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:33.076212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.121994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] MFA Rules not processed for user `f34efc431c7f41afb80c778e7489852f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:33.126968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:33.258207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:33.273654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 819/1652] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:33 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:33.366600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010ff0-2474-4e67-bb4b-54875de55c0f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:33.382909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:33.383639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:33.383896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:33.384174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.385125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:33.389177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:33.473291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:33.474580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 834/1653] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:33 2021] POST /identity/v3/projects => generated 355 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:33.513696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca930-0d9c-4227-a803-0e2116b6eee4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:33.642656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:33.643350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:33.643632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:33.643909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.653476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:33.658975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:33.694407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 820/1654] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:33 2021] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:33.699681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:33.721547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408e67-507f-4a5f-a565-87cb45c60e3c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:33.727879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:33.730786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:33.731085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:33.731430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.733796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:33.738494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:33.773222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 835/1655] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:33.777194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:33.800949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189883c0-6338-4c2b-8dc4-75906e9e22a3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:33.818026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:33.824041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:33.824569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:33.826238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] PATH_INFO: `/v3/projects/05d628d46ff14bef8c7637427fa5f2de/users/0a7e66356bff415c805f5ebfb04eb604/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:33.888156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d628d46ff14bef8c7637427fa5f2de, user_id=0a7e66356bff415c805f5ebfb04eb604, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:33.894003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:33.935297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 821/1656] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:33 2021] PUT /identity/v3/projects/05d628d46ff14bef8c7637427fa5f2de/users/0a7e66356bff415c805f5ebfb04eb604/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:33.939000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:33.957361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb4333-7245-4042-aa33-f1898d52f40a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:34.162720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:34.163645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:34.164084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:34.164573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:34.165878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:34.167614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dd3d-fe64-4337-868a-1cb8994946b2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:34.201370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 836/1657] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:34.202883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:34.224811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b0c2b-2ffb-4fbc-8a61-a0e3496115b4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:34.251850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:34.253768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:34.254413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:34.255137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] PATH_INFO: `/v3/projects/05d628d46ff14bef8c7637427fa5f2de/users/0a7e66356bff415c805f5ebfb04eb604/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:34.257529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d628d46ff14bef8c7637427fa5f2de, user_id=0a7e66356bff415c805f5ebfb04eb604, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:34.260797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:34.311090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 822/1658] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:34 2021] PUT /identity/v3/projects/05d628d46ff14bef8c7637427fa5f2de/users/0a7e66356bff415c805f5ebfb04eb604/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:34.371234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:34.372061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:34.372933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:34.424330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] MFA Rules not processed for user `0a7e66356bff415c805f5ebfb04eb604`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:34.427063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:34.640254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 837/1659] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:34 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:34.722439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:34.725481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:34.762713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:34.764155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:34.919114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29df12-1193-4f41-b8b5-ca230174a799 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:34.948543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:34.952676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:34.955483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:34.955940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:34.962797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:34.983112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035656b-2c12-4277-8971-774f8812b89e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:35.021503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:35.022193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:35.028307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:35.029378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:35.074790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:35.076124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67369286-32cb-4d31-9660-6ffac283a3e9 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:35.116532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 823/1660] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:34 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:35.118270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:35.121633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:35.121633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:35.157028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:35.158485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:35.174812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 838/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:34 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:35.188994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:35.192269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:35.339461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 824/1662] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 18 18:46:35 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:35.627077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:35.637982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d956d37-deba-4b39-a703-b261b0b19711 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:35.642176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:35.642869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:35.643885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:35.643885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:35.742575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:35.744917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:35.775325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 839/1663] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:35 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:38.404741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:38.409190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:38.409657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.411171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.516912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d06d1-b3a2-4dab-a23e-bc07316bccb3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:38.521892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:38.522866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.523214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.523579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] PATH_INFO: `/v3/users/1606827d14854cf5ae735804ed5cea82` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.525629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1606827d14854cf5ae735804ed5cea82)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:38.528707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e625fe-d435-4863-b065-c3d6a1d97760 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:38.537005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:38.537724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:38.538331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.538989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.539418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] PATH_INFO: `/v3/users/da3448febf084ab285f23d38701f61d6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.541564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3448febf084ab285f23d38701f61d6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:38.543894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:38.616890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1606827d14854cf5ae735804ed5cea82'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.626406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3448febf084ab285f23d38701f61d6'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.632057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1606827d14854cf5ae735804ed5cea82'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.639937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1606827d14854cf5ae735804ed5cea82'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.640415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3448febf084ab285f23d38701f61d6'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.643195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1606827d14854cf5ae735804ed5cea82'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.643893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5631b2de-7c10-48f1-bf32-31b87c74f40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1606827d14854cf5ae735804ed5cea82'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.649397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3448febf084ab285f23d38701f61d6'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.658968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 825/1664] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:38 2021] DELETE /identity/v3/users/1606827d14854cf5ae735804ed5cea82 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:38.663448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.663793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.664303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.665098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3448febf084ab285f23d38701f61d6'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.665912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e23abd9e-d9a9-41f0-83cb-232a38afaa7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3448febf084ab285f23d38701f61d6'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:38.673926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 840/1665] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:38 2021] DELETE /identity/v3/users/da3448febf084ab285f23d38701f61d6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:38.678584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.678858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.679136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.699777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:38.704242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.711775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:38.713063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.762419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 826/1666] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:38.771408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 841/1667] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:38.776073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:38.777583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.778964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:38.780694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:38.838138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02dd1a-e2b3-46ff-a02d-b603a190af46 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:38.842419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f033165-5932-494d-a101-7d4a587464d1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:38.847737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:38.848153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:38.848385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.848666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.848807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:38.848939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.849086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:38.849360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:38.858581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:38.859345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:38.859999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:38.860755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:38.869404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 842/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:38.870106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 827/1669] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:39.254038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.255549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:39.271156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce1d55-8d50-4de1-a9f7-6db66cd0288d service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:39.277634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:39.278838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.279124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.279431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] PATH_INFO: `/v3/projects/8a5eba873a194327bbc6271cfbd2c116` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.280729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5eba873a194327bbc6271cfbd2c116)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:39.282766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:39.330019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.332242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:39.354485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c6ff-9ec6-4c22-a265-6f40a435497d service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:39.362283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5eba873a194327bbc6271cfbd2c116', 'request_id': 'req-221d6840-5952-452e-b9cd-18ec1d1689fc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.370221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5eba873a194327bbc6271cfbd2c116', 'request_id': 'req-221d6840-5952-452e-b9cd-18ec1d1689fc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.380267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5eba873a194327bbc6271cfbd2c116', 'request_id': 'req-221d6840-5952-452e-b9cd-18ec1d1689fc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.406483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] The token cache is being invalidate because project 8a5eba873a194327bbc6271cfbd2c116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:39.406814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.411021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-221d6840-5952-452e-b9cd-18ec1d1689fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.424682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 843/1670] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:39 2021] DELETE /identity/v3/projects/8a5eba873a194327bbc6271cfbd2c116 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:39.426419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:39.428171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.430739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.431401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] PATH_INFO: `/v3/projects/f4e6b312330a4ba68a11b4c84a9ca089` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.433098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e6b312330a4ba68a11b4c84a9ca089)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:39.433215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b142-e27e-49fc-abd9-20f3191f3391 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.433574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b142-e27e-49fc-abd9-20f3191f3391 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.433988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b142-e27e-49fc-abd9-20f3191f3391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.436047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:39.469061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d368b142-e27e-49fc-abd9-20f3191f3391 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:39.470443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d368b142-e27e-49fc-abd9-20f3191f3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:39.487691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 844/1671] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:39.497287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.497808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.498266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.523767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e6b312330a4ba68a11b4c84a9ca089', 'request_id': 'req-29e2dd26-e513-430c-ad36-dc96b6965bfa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.537815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:39.539811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:39.555316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e6b312330a4ba68a11b4c84a9ca089', 'request_id': 'req-29e2dd26-e513-430c-ad36-dc96b6965bfa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.570876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e6b312330a4ba68a11b4c84a9ca089', 'request_id': 'req-29e2dd26-e513-430c-ad36-dc96b6965bfa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.598685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] The token cache is being invalidate because project f4e6b312330a4ba68a11b4c84a9ca089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:39.599235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.600059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.602266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 828/1672] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:39 2021] DELETE /identity/v3/projects/f4e6b312330a4ba68a11b4c84a9ca089 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:39.606509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.609080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:39.718030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 845/1673] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:39.719438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.735217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea973b5-5b25-4d42-bedb-fcd0d24c7564 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:39.757379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:39.758413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.758735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.759110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.762095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:39.762537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:39.766689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:39.767087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd26-e513-430c-ad36-dc96b6965bfa admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:39.778155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:39.779712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.780026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 846/1674] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:39.780517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.781110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] PATH_INFO: `/v3/users/c90176f54b2b42c0b1aa33780a559b16` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.783672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90176f54b2b42c0b1aa33780a559b16)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:39.784771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.786394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:39.795057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16d01b-d0f2-44c3-8b28-49783adc84b8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:39.800105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:39.800709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:39.801154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:39.801579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:39.802473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:39.804685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:39.857022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90176f54b2b42c0b1aa33780a559b16'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.876663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90176f54b2b42c0b1aa33780a559b16'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.885518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 847/1675] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:39 2021] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:46:39.887465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90176f54b2b42c0b1aa33780a559b16'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.889312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:39.889981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90176f54b2b42c0b1aa33780a559b16'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.899036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90176f54b2b42c0b1aa33780a559b16'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:39.914569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 829/1676] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:39 2021] DELETE /identity/v3/users/c90176f54b2b42c0b1aa33780a559b16 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:39.990500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f42-c428-433c-933a-98d34cec4ee9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.055378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.056063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.057288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.057574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.058943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.060884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.113135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 848/1677] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:39 2021] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:40.117285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.119464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:40.133985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a086d49-1be4-47ac-b367-9c46c03156ac admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.140023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.140706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.140983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.141259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.142006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.144937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.166490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 830/1678] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:40.167689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.182731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e63f-c9e3-47fd-a59a-7be2d6d3814f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.192763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.193443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.193728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.194012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.194796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.196378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.210058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 849/1679] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:40.211262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.225351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06353ac-87b6-4225-aa79-759992bccd89 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.234454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.235335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.236007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.236352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] PATH_INFO: `/v3/projects/21485090b4b949ae9169dd4ee0e918b1/users/a5f3ed1854014875948abfe77f557c75/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.254215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21485090b4b949ae9169dd4ee0e918b1, user_id=a5f3ed1854014875948abfe77f557c75, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.259107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d1d4-51f1-45d6-9f1e-59ad8b9af09e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.261038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.262973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:40.286100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f41bf-c767-41f0-a505-40a12fb0d709 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.310925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 831/1680] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:40 2021] PUT /identity/v3/projects/21485090b4b949ae9169dd4ee0e918b1/users/a5f3ed1854014875948abfe77f557c75/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:40.312840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.313289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.313579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.348019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] MFA Rules not processed for user `a5f3ed1854014875948abfe77f557c75`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:40.349418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:40.388274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.389374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.389801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.390266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] PATH_INFO: `/v3/projects/84fced3e5f1f40a79b36b6363028b6b5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.391662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fced3e5f1f40a79b36b6363028b6b5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.393801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.439811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 832/1681] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:40 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:40.444398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.454662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fced3e5f1f40a79b36b6363028b6b5', 'request_id': 'req-636da447-cc32-4da0-87ce-d627b0e3d1d4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.456090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26639-dab0-418e-9b08-1c14b9405494 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.461142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fced3e5f1f40a79b36b6363028b6b5', 'request_id': 'req-636da447-cc32-4da0-87ce-d627b0e3d1d4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.470384 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fced3e5f1f40a79b36b6363028b6b5', 'request_id': 'req-636da447-cc32-4da0-87ce-d627b0e3d1d4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.500060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] The token cache is being invalidate because project 84fced3e5f1f40a79b36b6363028b6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:40.500354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.501288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.506375 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 850/1682] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:40 2021] DELETE /identity/v3/projects/84fced3e5f1f40a79b36b6363028b6b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:40.507093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.508588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:40.549294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.550018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.550303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.550643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.551361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.553843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.602044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 833/1683] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:40 2021] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:40.603041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.607937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:40.609542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da447-cc32-4da0-87ce-d627b0e3d1d4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.702741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.704313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.705585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.705866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] PATH_INFO: `/v3/users/91a70160f1d5445a867f4b8d4e1fc6ff` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.707585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a70160f1d5445a867f4b8d4e1fc6ff)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.709511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.720952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4da27-e04a-4893-8835-18f269e379be admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.727882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.728955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.729462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.730030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.731140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.733947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.773298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 834/1684] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:40 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:40.782933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.795963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f0159-3d3d-4469-9cef-bee11dba79ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.801496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.802257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.802565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.803009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.803643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.809341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.809988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a70160f1d5445a867f4b8d4e1fc6ff'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.827318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 835/1685] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:46:40.829547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.829765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a70160f1d5445a867f4b8d4e1fc6ff'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.840588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1785d85-67c1-4899-9789-e82e96c58745 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:40.851102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a70160f1d5445a867f4b8d4e1fc6ff'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.851849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:40.851849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:40.851849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:40.852173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] PATH_INFO: `/v3/projects/39debd7f9bb54397a6ce180d03044d13/users/2a1fbad33edb40b1b453815a9a366b74/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:40.864530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a70160f1d5445a867f4b8d4e1fc6ff'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.865693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a70160f1d5445a867f4b8d4e1fc6ff'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:40.868119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39debd7f9bb54397a6ce180d03044d13, user_id=2a1fbad33edb40b1b453815a9a366b74, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:40.877033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:40.891310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 851/1686] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:46:40 2021] DELETE /identity/v3/users/91a70160f1d5445a867f4b8d4e1fc6ff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:40.898295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 836/1687] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:40 2021] PUT /identity/v3/projects/39debd7f9bb54397a6ce180d03044d13/users/2a1fbad33edb40b1b453815a9a366b74/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:40.903647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:40.905682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.039866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb093a1f-7bad-4721-99e8-74c681a4886c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.119278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.119991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.120306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.120575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.121424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.124053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e577b-29d5-4088-bd2b-13f15b6020a7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.143044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 852/1688] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:41.144380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.157083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ecc3-adc5-4b4b-ac52-c402d3311005 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.163685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.164687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.165004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.165285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] PATH_INFO: `/v3/projects/39debd7f9bb54397a6ce180d03044d13/users/2a1fbad33edb40b1b453815a9a366b74/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.167589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39debd7f9bb54397a6ce180d03044d13, user_id=2a1fbad33edb40b1b453815a9a366b74, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.170401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.182030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 837/1689] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:41 2021] PUT /identity/v3/projects/39debd7f9bb54397a6ce180d03044d13/users/2a1fbad33edb40b1b453815a9a366b74/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:41.235298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.235704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.235988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.261788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] MFA Rules not processed for user `2a1fbad33edb40b1b453815a9a366b74`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:41.263024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.333194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 853/1690] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:41 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:41.344198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.345910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.394583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.395997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.404832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731342b5-8f8e-4e20-a6cc-083620ca1656 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.408955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.410072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.410661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.410948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.421180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.422719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.434184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 838/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:41 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:41.469061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fcf9b-8e32-4582-a81d-98f0ff5ed814 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.474335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.475635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.475635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.475775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] PATH_INFO: `/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.477070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d9fb2fbf6f4bfca6ff920bb128e886)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.478974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.508382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.516978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d26b4-1dc4-4327-970d-26354795f51d service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.522047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.522800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.523077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.524004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.527330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.534503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d9fb2fbf6f4bfca6ff920bb128e886', 'request_id': 'req-6b865b32-ace5-41fc-99ea-290ea81debc3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:41.539564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d9fb2fbf6f4bfca6ff920bb128e886', 'request_id': 'req-6b865b32-ace5-41fc-99ea-290ea81debc3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:41.546880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d9fb2fbf6f4bfca6ff920bb128e886', 'request_id': 'req-6b865b32-ace5-41fc-99ea-290ea81debc3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:41.559698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] The token cache is being invalidate because project 64d9fb2fbf6f4bfca6ff920bb128e886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:46:41.560044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:41.561581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b865b32-ace5-41fc-99ea-290ea81debc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:46:41.563324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 854/1692] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:46:41 2021] DELETE /identity/v3/projects/64d9fb2fbf6f4bfca6ff920bb128e886 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:46:41.569823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.570091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.570365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.586639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.588226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:41.588640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6f8aa-bf52-40c9-bd9d-8a054a9f358e service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.589399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.597360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 839/1693] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:41 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:46:41.645734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 855/1694] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:46:41.656238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.656529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.656806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.677321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:41.678563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:41.687764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 840/1695] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:41.692056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.708192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737716-20e7-4812-89e8-4615bf4684fb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.715204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.716515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.716811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.717086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.717992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:46:41.718298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.720923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.734580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 856/1696] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:46:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:46:41.738960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.748225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209c5f-8237-4f4d-8ce0-c07ab27e4680 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.753201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.753847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.754125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.754406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.755143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.757241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.786435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 841/1697] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:41 2021] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:41.788366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.798177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e6b42-1773-4732-aebe-9ab98d18d14a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.852126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.852796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.853103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.853378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.854102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.856033 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.875838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 857/1698] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:41 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:41.880005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.890568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee7fb-eb82-4d14-9e8f-0bad5b076bed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.895155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.896145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.896369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.896641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.897405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.899020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.908850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 842/1699] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:41.912805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.923141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19259bdb-affa-43a6-bf12-95d5cb5fb927 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.927719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.928358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.928656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.928928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.929656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.931424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83c642-c5e4-4954-8fc2-cc7a19c96b6a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.941827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 858/1700] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:41.946057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:41.956269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c8e8-0e25-48de-b02f-512b02f4842e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:41.960775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:41.961639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:41.961915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:41.962184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] PATH_INFO: `/v3/projects/7674641701914d11923dcdb7cf5e1e1a/users/a00380d961804a379932f9e851bb98c0/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:41.976613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7674641701914d11923dcdb7cf5e1e1a, user_id=a00380d961804a379932f9e851bb98c0, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:41.979350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:41.996514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 843/1701] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:41 2021] PUT /identity/v3/projects/7674641701914d11923dcdb7cf5e1e1a/users/a00380d961804a379932f9e851bb98c0/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:42.008471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.008754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.009092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.037237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] MFA Rules not processed for user `a00380d961804a379932f9e851bb98c0`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:42.038474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:42.131641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 859/1702] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:42.137392 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.222918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3cf0-fcc9-422b-a546-3667ef27c6f2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.231636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.232278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.232554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.232824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.233529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.235900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.266525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 844/1703] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:46:42 2021] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:46:42.270853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.282217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6f63-37e6-42f6-bf78-f6a42dadfcc5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.337944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.338757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.339100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.339708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.340234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.342212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.365442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 860/1704] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:46:42 2021] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:46:42.367114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.378122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722b329-5d84-4f8f-bab9-f5d7264c5102 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.382967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.383620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.383922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.384197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.384994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.386634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.396741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 845/1705] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:42.401336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.411050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e878d-4535-4b87-bac7-0716b65ab244 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.415491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.416919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.417198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.417470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] PATH_INFO: `/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a/users/99c7450daf86421c8d0dac4c223b095f/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.432051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68991b4a7cc547b18d54a1b4239c3d9a, user_id=99c7450daf86421c8d0dac4c223b095f, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.435202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.448201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 861/1706] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:42 2021] PUT /identity/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a/users/99c7450daf86421c8d0dac4c223b095f/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:42.451960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.461794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d80f7-5841-4f93-bcfd-d6c3c4b2fdda admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.515263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.515916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.516203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.516493 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.517209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.518865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53aee-db3d-49e7-95a8-151d6a0a749e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.528798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 846/1707] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:46:42.532775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.542746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5685cb5-9544-45ee-a5e8-0181b33476a0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.547252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.548119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.548398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.548671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] PATH_INFO: `/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a/users/99c7450daf86421c8d0dac4c223b095f/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.550634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68991b4a7cc547b18d54a1b4239c3d9a, user_id=99c7450daf86421c8d0dac4c223b095f, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.553422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.563965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 862/1708] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:46:42 2021] PUT /identity/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a/users/99c7450daf86421c8d0dac4c223b095f/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:46:42.575437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974967f-31c0-4977-8948-162a060509bc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.575725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974967f-31c0-4977-8948-162a060509bc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.576004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974967f-31c0-4977-8948-162a060509bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.602874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7974967f-31c0-4977-8948-162a060509bc None None] MFA Rules not processed for user `99c7450daf86421c8d0dac4c223b095f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:42.604063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7974967f-31c0-4977-8948-162a060509bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:42.667110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 847/1709] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:46:42 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:42.676993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.678696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:42.732226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8032a-7cdf-4866-a91c-864b2e5cf97c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.736314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.736591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.736768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.737028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.745838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.747281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.756990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 863/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:42.805661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974967f-31c0-4977-8948-162a060509bc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.816069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974967f-31c0-4977-8948-162a060509bc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:42.820939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:42.821921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:42.822209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:42.822485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:42.879836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:42.881268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:42.892476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 848/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:42.901595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.904713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:42.906918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:42.909232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:43.031841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c226f-4ce4-44a6-b341-aeafd24c9c56 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:43.037846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6c67-9b88-4080-97eb-e9910f9fbe81 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:43.040370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:43.041187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:43.041470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:43.041750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:43.043949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:43.045715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:43.047072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:43.047455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:43.048014 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:43.054008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:43.055675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d769e8-aa88-4c41-81a3-b524af4c004e service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:43.065912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 864/1712] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:43.070406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:43.072071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d13d25-d32c-4290-9475-363d7d584574 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:43.082438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 849/1713] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:44.641805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:44.642350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:44.642350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:44.644206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 865/1714] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:46:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:46:44.666760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5516a0-cd8d-4d9f-9599-dd7197a7b5d4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:44.667340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5516a0-cd8d-4d9f-9599-dd7197a7b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:44.667340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5516a0-cd8d-4d9f-9599-dd7197a7b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:44.698613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3a5516a0-cd8d-4d9f-9599-dd7197a7b5d4 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:44.700209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3a5516a0-cd8d-4d9f-9599-dd7197a7b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:44.793277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 850/1715] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:46:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:45.118827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:45.120601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:45.174820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cd5b-1169-42ca-828f-58b6963ba884 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:45.183493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:45.184846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:45.185316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:45.185738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:45.199729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:45.201660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443533a-72fc-4762-9b23-66d8c143fb88 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:45.214861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 866/1716] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:46:45.590162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:45.590446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:45.590749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:45.592662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 851/1717] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:46:45.619958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:45.620641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:45.621293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:45.653217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:46:45.655094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:45.668927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 867/1718] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:46:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:46:45.697783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:46:45.699297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:46:45.741534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e191be-9d6e-427d-9cb5-6e488f095e24 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:46:45.758292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:46:45.761900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:46:45.762591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:46:45.763928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:46:45.788930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:46:45.790590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691557-6959-415a-8af8-7faf1a85b542 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:46:45.819549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 852/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:46:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:01.065684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:01.127370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef28c41-3f33-4682-8db7-524a84c7c175 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:01.132482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:01.133355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:01.133633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:01.134615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] PATH_INFO: `/v3/users/a00380d961804a379932f9e851bb98c0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:01.135796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00380d961804a379932f9e851bb98c0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:01.137997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:01.185673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00380d961804a379932f9e851bb98c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.192924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00380d961804a379932f9e851bb98c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.199814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00380d961804a379932f9e851bb98c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.211598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00380d961804a379932f9e851bb98c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.212378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00380d961804a379932f9e851bb98c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.218406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 868/1720] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:01 2021] DELETE /identity/v3/users/a00380d961804a379932f9e851bb98c0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:01.222984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:01.223485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:01.223581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:01.241454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:01.242698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:01.300197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 853/1721] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:01.311857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:01.314423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:01.366906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189690a2-5c51-43c6-bfac-5fe5ff2a0b29 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:01.371034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:01.371668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:01.371947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:01.372221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:01.382885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:01.384360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:01.394065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 869/1722] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:01.703049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:01.704571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:01.718613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff205c0-44a4-4115-9c72-84ccf7dbdb86 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:01.725464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:01.726350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:01.726669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:01.726951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] PATH_INFO: `/v3/projects/7674641701914d11923dcdb7cf5e1e1a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:01.728979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7674641701914d11923dcdb7cf5e1e1a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:01.731304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:01.789604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7674641701914d11923dcdb7cf5e1e1a', 'request_id': 'req-245f9c42-9b28-4a72-ad71-90e443697314'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.798046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7674641701914d11923dcdb7cf5e1e1a', 'request_id': 'req-245f9c42-9b28-4a72-ad71-90e443697314'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.802365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7674641701914d11923dcdb7cf5e1e1a', 'request_id': 'req-245f9c42-9b28-4a72-ad71-90e443697314'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.815749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] The token cache is being invalidate because project 7674641701914d11923dcdb7cf5e1e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:01.816062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.816797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.818216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 854/1723] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:01 2021] DELETE /identity/v3/projects/7674641701914d11923dcdb7cf5e1e1a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:01.822229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:01.835138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fff32-befe-456d-8699-8aba89f7551d service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:01.891317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:01.892181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:01.892462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:01.892737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] PATH_INFO: `/v3/users/99c7450daf86421c8d0dac4c223b095f` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:01.893933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c7450daf86421c8d0dac4c223b095f)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:01.895942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:01.940997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c7450daf86421c8d0dac4c223b095f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.955447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c7450daf86421c8d0dac4c223b095f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.963336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c7450daf86421c8d0dac4c223b095f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.975532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c7450daf86421c8d0dac4c223b095f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.976255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-57dcc9fc-7cbb-4d20-a9db-f5de7811ede7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c7450daf86421c8d0dac4c223b095f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:01.983415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 870/1724] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:01 2021] DELETE /identity/v3/users/99c7450daf86421c8d0dac4c223b095f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:02.272811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.274266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:02.300567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9c42-9b28-4a72-ad71-90e443697314 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.378481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.379551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.379782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.380079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] PATH_INFO: `/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.381326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68991b4a7cc547b18d54a1b4239c3d9a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.383483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.433176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68991b4a7cc547b18d54a1b4239c3d9a', 'request_id': 'req-fe6d9250-8868-4364-a42e-89038cfea973'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:02.438368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68991b4a7cc547b18d54a1b4239c3d9a', 'request_id': 'req-fe6d9250-8868-4364-a42e-89038cfea973'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:02.444357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68991b4a7cc547b18d54a1b4239c3d9a', 'request_id': 'req-fe6d9250-8868-4364-a42e-89038cfea973'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:02.457243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] The token cache is being invalidate because project 68991b4a7cc547b18d54a1b4239c3d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:02.457472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:02.458123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-fe6d9250-8868-4364-a42e-89038cfea973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:02.459739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 855/1725] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:02 2021] DELETE /identity/v3/projects/68991b4a7cc547b18d54a1b4239c3d9a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:02.466466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.466962 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.467189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.486732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:02.487999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:02.546148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 871/1726] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:02.553927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.554210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.554491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.575310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:02.576618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:02.585189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 856/1727] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:02.589882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.599533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6d01a-625f-49fb-95e4-8589ee257b92 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.604817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.605460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.605741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.606019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.606777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:02.607084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.608677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.620066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 872/1728] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:02.624526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.633770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8506-e74e-4f61-99cc-7f3332cac2c2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.638597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.639245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.639521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.639790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.640507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.642446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.667129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 857/1729] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:02 2021] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:02.671218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.680798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03032bd-c5e1-4843-bc50-e1883e82e797 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.733672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.734284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.734587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.734866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.735580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.737603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.758222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 873/1730] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:02 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:02.763732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.773717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74ac7-c93b-45f5-ab44-a3c487106d4f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.778947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.779506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.779816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.780040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.780771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.782337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.792694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 858/1731] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:02.798804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.809308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850584-5f87-4c6a-848f-623e71c3355b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.814822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.815579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.815928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.816273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.817125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.818815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30ffe0-2cef-4d62-878b-e6a1ad6f8c51 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.833873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 874/1732] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:02.835469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:02.846942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0a51-0d1d-470c-89ac-9ccff4c7c0d2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:02.852364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:02.853481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.853883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.854264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] PATH_INFO: `/v3/projects/26fee0cb5a814e81a848d78f2f003efe/users/f2523dd3e70441db8475f1898d7cca14/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.874261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fee0cb5a814e81a848d78f2f003efe, user_id=f2523dd3e70441db8475f1898d7cca14, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:02.877286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:02.898820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 859/1733] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:02 2021] PUT /identity/v3/projects/26fee0cb5a814e81a848d78f2f003efe/users/f2523dd3e70441db8475f1898d7cca14/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:02.909119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:02.909408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:02.909685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:02.939518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] MFA Rules not processed for user `f2523dd3e70441db8475f1898d7cca14`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:02.941013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:03.020365 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 875/1734] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:02 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:03.025495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.099895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8adb-fb1b-4e38-a1a7-fa432ab54e6e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.105519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.106240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.106523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.106861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.107665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.109751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.142580 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 860/1735] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:03 2021] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:03.145482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.159141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847480fc-eed5-45a4-8048-83dd3e9d3eeb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.225015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.225797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.226076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.226401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.227195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.229191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.254424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 876/1736] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:03 2021] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:03.255843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.270136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5a063-ba6c-4e93-88ed-b038b5951a03 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.275812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.276787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.276910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.277355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.278096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.279834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.292140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 861/1737] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:03.296319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.307466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933128-43df-452e-97c6-91c1438106ea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.312807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.313782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.314117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.314426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] PATH_INFO: `/v3/projects/209919fd5e8d470ca634c1f693f730d8/users/4d892eb205734fe18f8be82d870c25f7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.331082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209919fd5e8d470ca634c1f693f730d8, user_id=4d892eb205734fe18f8be82d870c25f7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.334439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.349923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 877/1738] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:03 2021] PUT /identity/v3/projects/209919fd5e8d470ca634c1f693f730d8/users/4d892eb205734fe18f8be82d870c25f7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:03.354801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.365104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a351da-a681-4456-8cd0-e314be4f904e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.442317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.442904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.443331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.443786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.444623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.447993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce67e-d1ca-4a05-950f-1e208ce44473 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.459814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 862/1739] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:03 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:03.464522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.483996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f1dd-c3d1-4a43-8918-dc78cafb8ef2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.489805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.490653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.491190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.491616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] PATH_INFO: `/v3/projects/209919fd5e8d470ca634c1f693f730d8/users/4d892eb205734fe18f8be82d870c25f7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.494048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] RBAC: Authorizing `identity:create_grant(project_id=209919fd5e8d470ca634c1f693f730d8, user_id=4d892eb205734fe18f8be82d870c25f7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.497330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.511635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 878/1740] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:03 2021] PUT /identity/v3/projects/209919fd5e8d470ca634c1f693f730d8/users/4d892eb205734fe18f8be82d870c25f7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:03.522942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.523363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.523740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.556422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] MFA Rules not processed for user `4d892eb205734fe18f8be82d870c25f7`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:03.558009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:03.635469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 863/1741] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:03 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:03.645605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.647465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:03.702293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73384-3681-4d89-a403-c9c3c5e9651a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.705882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.706509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.706814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.707088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.716532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.717937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af16d0-1b69-4dc3-b235-6bfcc028a43e service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.727996 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 879/1742] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:03 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:03.843454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:03.901331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69891f-2ec9-4b59-9a81-40753fb9b686 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:03.905697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:03.906567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.906842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.907111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] PATH_INFO: `/v3/users/f2523dd3e70441db8475f1898d7cca14` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:03.908346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2523dd3e70441db8475f1898d7cca14)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:03.910169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:03.952463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2523dd3e70441db8475f1898d7cca14'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:03.963586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2523dd3e70441db8475f1898d7cca14'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:03.970036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2523dd3e70441db8475f1898d7cca14'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:03.970712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2523dd3e70441db8475f1898d7cca14'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:03.971307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2523dd3e70441db8475f1898d7cca14'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:03.983484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 864/1743] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:03 2021] DELETE /identity/v3/users/f2523dd3e70441db8475f1898d7cca14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:03.988056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:03.988415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:03.988782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.006666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:04.007852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.061928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 880/1744] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:04.072502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:04.073899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.138997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6237a1-bf62-4973-af34-d28c0aaaba9f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:04.143779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:04.144626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:04.145080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:04.145543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.159423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:04.162767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa8ef8-ff7c-4c12-b38d-819e174ffee4 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:04.172016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 865/1745] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:04.315599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:04.318462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.369489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671890-7905-42bd-bad7-75446d9290e5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:04.386747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:04.387628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:04.387957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:04.388309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] PATH_INFO: `/v3/users/a5f3ed1854014875948abfe77f557c75` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.390321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f3ed1854014875948abfe77f557c75)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:04.392452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:04.471237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f3ed1854014875948abfe77f557c75'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.482168 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f3ed1854014875948abfe77f557c75'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.508623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f3ed1854014875948abfe77f557c75'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.527807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f3ed1854014875948abfe77f557c75'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.531728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f3ed1854014875948abfe77f557c75'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.545152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 881/1746] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:04 2021] DELETE /identity/v3/users/a5f3ed1854014875948abfe77f557c75 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:04.549541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:04.550089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:04.550307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.574093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:04.575491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.726666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 866/1747] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:04.738244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:04.740895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.760544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:04.765789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:04.795814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a757-5d05-4b9c-bf2c-13ebbd8e738f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:04.811666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:04.812691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:04.812984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:04.813266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] PATH_INFO: `/v3/projects/26fee0cb5a814e81a848d78f2f003efe` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.817700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fee0cb5a814e81a848d78f2f003efe)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:04.820078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:04.910760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d27b-1021-4c2e-b9c7-056c9fa2cc01 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:04.916822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:04.917492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:04.917817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:04.918101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:04.928748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:04.930224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:04.944024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 882/1748] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:04.961501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fee0cb5a814e81a848d78f2f003efe', 'request_id': 'req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.968266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fee0cb5a814e81a848d78f2f003efe', 'request_id': 'req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:04.976129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fee0cb5a814e81a848d78f2f003efe', 'request_id': 'req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.002714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] The token cache is being invalidate because project 26fee0cb5a814e81a848d78f2f003efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:05.003985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.005644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.010052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 867/1749] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:04 2021] DELETE /identity/v3/projects/26fee0cb5a814e81a848d78f2f003efe => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:05.014712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:05.029322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31fdf-9d56-4aec-805b-ddd551cc563f service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:05.118106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:05.130934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.138842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.138842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] PATH_INFO: `/v3/users/4d892eb205734fe18f8be82d870c25f7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.140851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d892eb205734fe18f8be82d870c25f7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:05.143325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:05.199511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d892eb205734fe18f8be82d870c25f7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.209987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d892eb205734fe18f8be82d870c25f7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.220753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d892eb205734fe18f8be82d870c25f7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.239793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d892eb205734fe18f8be82d870c25f7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.240602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d892eb205734fe18f8be82d870c25f7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.249468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 883/1750] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:05 2021] DELETE /identity/v3/users/4d892eb205734fe18f8be82d870c25f7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:05.427069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:05.428529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:05.447232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b1f8-fa5c-45aa-9a80-e6993ee9805f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:05.527726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:05.528896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.529251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.529647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] PATH_INFO: `/v3/projects/21485090b4b949ae9169dd4ee0e918b1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.531193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21485090b4b949ae9169dd4ee0e918b1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:05.533593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:05.580026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:05.581729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:05.595040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed472c2-058b-4a92-ad42-2be4f75719ba admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:05.597407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21485090b4b949ae9169dd4ee0e918b1', 'request_id': 'req-3744197b-95bd-4e70-95c8-1fab923fc061'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.603616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21485090b4b949ae9169dd4ee0e918b1', 'request_id': 'req-3744197b-95bd-4e70-95c8-1fab923fc061'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.610937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21485090b4b949ae9169dd4ee0e918b1', 'request_id': 'req-3744197b-95bd-4e70-95c8-1fab923fc061'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.625505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] The token cache is being invalidate because project 21485090b4b949ae9169dd4ee0e918b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:05.626149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.626880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.628488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 868/1751] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:05 2021] DELETE /identity/v3/projects/21485090b4b949ae9169dd4ee0e918b1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:05.632303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:05.634329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:05.662075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:05.663095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.663513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.663793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] PATH_INFO: `/v3/projects/209919fd5e8d470ca634c1f693f730d8` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.665717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209919fd5e8d470ca634c1f693f730d8)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:05.667762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:05.701435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744197b-95bd-4e70-95c8-1fab923fc061 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:05.707571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:05.708461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.708748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.709026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] PATH_INFO: `/v3/users/2a1fbad33edb40b1b453815a9a366b74` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.710721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1fbad33edb40b1b453815a9a366b74)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:05.719551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209919fd5e8d470ca634c1f693f730d8', 'request_id': 'req-0a25e005-b8ba-4025-b0e7-94ba49d44227'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.721595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:05.726740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209919fd5e8d470ca634c1f693f730d8', 'request_id': 'req-0a25e005-b8ba-4025-b0e7-94ba49d44227'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.737525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209919fd5e8d470ca634c1f693f730d8', 'request_id': 'req-0a25e005-b8ba-4025-b0e7-94ba49d44227'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.751483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] The token cache is being invalidate because project 209919fd5e8d470ca634c1f693f730d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:05.751779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.752514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-0a25e005-b8ba-4025-b0e7-94ba49d44227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.754272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 884/1752] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:05 2021] DELETE /identity/v3/projects/209919fd5e8d470ca634c1f693f730d8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:05.760567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.760926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.761277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.784046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1fbad33edb40b1b453815a9a366b74'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.794336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:05.795683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:05.801920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1fbad33edb40b1b453815a9a366b74'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.810270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1fbad33edb40b1b453815a9a366b74'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.811087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1fbad33edb40b1b453815a9a366b74'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.811838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eeb309d9-6256-482d-bd35-e82cd0269336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1fbad33edb40b1b453815a9a366b74'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:05.830070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 869/1753] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:05 2021] DELETE /identity/v3/users/2a1fbad33edb40b1b453815a9a366b74 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:05.907925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 885/1754] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:05.908992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:05.909789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:05.910072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:05.929531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:05.931408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.010219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 870/1755] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:06.014742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.029618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae05ce-b741-4c15-8b3f-579b7a498d9f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.035734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.036411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.036698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.036970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.037715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:06.038025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.040089 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.078908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 886/1756] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:06.083376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.094571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49409-85fe-4828-b8c0-3b1a1a3625c7 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.102220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.103031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.103314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.103587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.104315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.106590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.156773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 871/1757] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:06.157905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.170775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2824ce-e1a6-4aec-a906-b063be8deae8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.297961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.298605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.298893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.299533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.299884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.301818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.328495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.332932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.345264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 887/1758] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:06.351749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.364337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58bd60-af51-4f1c-a820-27a26ffcd675 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.372530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.374796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.375835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.376368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.377473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.380630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.393161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586503b0-883d-4581-99e0-9b0e4862b995 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.396532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 888/1759] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:06.400102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.414539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a2363-00cb-44ab-8b82-dc5e27004e1f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.419498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.420381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.420665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.420938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] PATH_INFO: `/v3/projects/39debd7f9bb54397a6ce180d03044d13` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.422166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39debd7f9bb54397a6ce180d03044d13)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.424373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.428524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.431213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.433693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.434464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.436823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.441107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.497043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 889/1760] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:06.498024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.511640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c8392-f15a-4479-bc99-715094f3d2e1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.512052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39debd7f9bb54397a6ce180d03044d13', 'request_id': 'req-b2058193-d6fe-4f91-8398-94c26af094e2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.524157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39debd7f9bb54397a6ce180d03044d13', 'request_id': 'req-b2058193-d6fe-4f91-8398-94c26af094e2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.536358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39debd7f9bb54397a6ce180d03044d13', 'request_id': 'req-b2058193-d6fe-4f91-8398-94c26af094e2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.556933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] The token cache is being invalidate because project 39debd7f9bb54397a6ce180d03044d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:06.557478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.558757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b2058193-d6fe-4f91-8398-94c26af094e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.561076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 872/1761] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:06 2021] DELETE /identity/v3/projects/39debd7f9bb54397a6ce180d03044d13 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:06.567170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf842d9-0d33-4bcc-9891-7d2585bc30f0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.572200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf842d9-0d33-4bcc-9891-7d2585bc30f0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.572200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf842d9-0d33-4bcc-9891-7d2585bc30f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.598588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fcf842d9-0d33-4bcc-9891-7d2585bc30f0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:06.599903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fcf842d9-0d33-4bcc-9891-7d2585bc30f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.600853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.602955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.603543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.604019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] PATH_INFO: `/v3/projects/d79b6b942fc748049e75f83fe647113f/users/caabc2fa3ab446378be10b6220054828/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.612818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 873/1762] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:06.621372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.622362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.623270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.630780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79b6b942fc748049e75f83fe647113f, user_id=caabc2fa3ab446378be10b6220054828, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.634358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2c99e-a3f9-4552-be0b-711a38178441 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.648549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:06.650231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.667105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 890/1763] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:06 2021] PUT /identity/v3/projects/d79b6b942fc748049e75f83fe647113f/users/caabc2fa3ab446378be10b6220054828/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:06.669136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.669543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.670106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.700424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] MFA Rules not processed for user `caabc2fa3ab446378be10b6220054828`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:06.701840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.735624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 874/1764] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:06.739920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.749763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492387-e9b7-4710-adca-5a9c07f94ec6 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.758467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.759987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.760271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.760548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.761306 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:06.761878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.763726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.778895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 875/1765] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:06.784242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.786517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.793730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 891/1766] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:06.795035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.803638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f9c12-9b79-4714-8bc0-93269cde5d06 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.808574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b241-c5c2-4a59-9959-c6cb0dffab41 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.809236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.810309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.810621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.811035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] PATH_INFO: `/v3/users/f34efc431c7f41afb80c778e7489852f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.812302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34efc431c7f41afb80c778e7489852f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.814293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.815032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.815866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.816299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.816826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.817675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.820142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:06.854183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 892/1767] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/projects => generated 401 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:06.855043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.856638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.868215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34efc431c7f41afb80c778e7489852f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.883122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34efc431c7f41afb80c778e7489852f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.890577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34efc431c7f41afb80c778e7489852f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.891494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34efc431c7f41afb80c778e7489852f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.892186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34efc431c7f41afb80c778e7489852f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:06.908951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 876/1768] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:06 2021] DELETE /identity/v3/users/f34efc431c7f41afb80c778e7489852f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:06.908951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:06.908951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:06.929367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f020b-aba5-4cfd-8e98-e153ddad8d06 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.975911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70138-284a-492d-8fb7-085656c84a6c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:06.981403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:06.982095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:06.982457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:06.982852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:06.983642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:06.985651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285ca5-4e86-4a31-8333-00bd8bc9dde0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.013393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.014067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.014518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 877/1769] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:07.014671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.015725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.016018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.016671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.018223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.019108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.021064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.039710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:07.042496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.059507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 878/1770] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:07.059781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.060553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 893/1771] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:06 2021] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:07.068335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.070513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.072035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f61fc-5ddb-4b07-b40f-354968d56452 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.156911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.157595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.158451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.158775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.159535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.161737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.163673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd121-61f2-489c-9af3-ba6c55196145 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.167595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.168353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.168737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.169114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.169924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.172127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.174744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 879/1772] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:07.175713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.179987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.211878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 894/1773] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:07.212743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.225835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9250e-c339-424e-861e-4fd0066a2b92 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.231905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.232572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.232855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.233129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.233872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.235518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.246685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 895/1774] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:07.247693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.261389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c73b51-6142-4cd7-96ea-3dc5d9d4fa81 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.262108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee536-148e-49ca-99bb-9a20b837fa9e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.265269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.265924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.266203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.266475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.267816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.268520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.268905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.269969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.270972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.272744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.276780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.278738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.292799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 896/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:07.293668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.299308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 880/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:07.300297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.311287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fc711-0fd5-4a79-a58b-280477a5a4d4 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.312414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfe7c-4923-45ab-a708-1078711d7646 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.316519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.317664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.317860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.318237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.318514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] PATH_INFO: `/v3/projects/3fd4dcb59eb1457291e82e588e922044/users/75b2119f16484fce98dbffd3745d7184/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.318636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.318972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.319145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] PATH_INFO: `/v3/projects/120f6449849a43b29648022ae43b30c7/users/5c6ca4df8f52424aa87876e2a41e45e1/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.340972 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd4dcb59eb1457291e82e588e922044, user_id=75b2119f16484fce98dbffd3745d7184, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.345238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120f6449849a43b29648022ae43b30c7, user_id=5c6ca4df8f52424aa87876e2a41e45e1, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.347500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.349134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790874b3-488e-4e66-a665-c7d5eb602d38 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.377970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 881/1777] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:07 2021] PUT /identity/v3/projects/3fd4dcb59eb1457291e82e588e922044/users/75b2119f16484fce98dbffd3745d7184/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:07.379113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.380155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 897/1778] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:07 2021] PUT /identity/v3/projects/120f6449849a43b29648022ae43b30c7/users/5c6ca4df8f52424aa87876e2a41e45e1/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:07.390100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.390418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.390682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.433740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] MFA Rules not processed for user `5c6ca4df8f52424aa87876e2a41e45e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:07.435240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.514088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cdd61-1567-4a9b-b147-7c430944a856 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.579185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.580215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.580699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.581158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.582211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.584225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.597862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 898/1779] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:07.598576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 882/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:07.600095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.600683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.609233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca97847-48a2-4e6d-9fa4-531b7be25d30 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.612592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cf235-41ca-495c-8fc5-bd075666d9c8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.614332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.615092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.615452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.615801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.616578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.617993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.619281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.619583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.619932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.620276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] PATH_INFO: `/v3/projects/3fd4dcb59eb1457291e82e588e922044/users/75b2119f16484fce98dbffd3745d7184/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.622453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd4dcb59eb1457291e82e588e922044, user_id=75b2119f16484fce98dbffd3745d7184, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.625338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf0aa9-3d8c-415a-a7dc-1e5909c2a2af admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.637861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 899/1781] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:07 2021] PUT /identity/v3/projects/3fd4dcb59eb1457291e82e588e922044/users/75b2119f16484fce98dbffd3745d7184/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:07.649107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.649433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.649704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.651523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 883/1782] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:07.655638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.678970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] MFA Rules not processed for user `75b2119f16484fce98dbffd3745d7184`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:07.680329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.735253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674cd7-6a07-401a-8741-6b4eeff48cf9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.740558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.741236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.741518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.741810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.742508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.745276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.769316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 884/1783] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/users => generated 306 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:07.770148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.771896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.779147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 900/1784] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:07 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:07.780451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.787442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595ea6-d150-43fb-a535-07d04db0d505 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.793236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bd7af-c779-4b14-91d2-571b09bbced2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.795200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.797250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.797520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.797798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] PATH_INFO: `/v3/projects/1b1662098f4c41578ca8ef34382e5855` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.799111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.799430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1662098f4c41578ca8ef34382e5855)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.801434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.809264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.812169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.812966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.814497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.816630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.835437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 901/1785] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:07.836507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.838798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.868556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1662098f4c41578ca8ef34382e5855', 'request_id': 'req-6f1a95bb-40de-4611-bc50-0a99767a3848'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:07.874192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1662098f4c41578ca8ef34382e5855', 'request_id': 'req-6f1a95bb-40de-4611-bc50-0a99767a3848'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:07.880849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1662098f4c41578ca8ef34382e5855', 'request_id': 'req-6f1a95bb-40de-4611-bc50-0a99767a3848'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:07.892981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] The token cache is being invalidate because project 1b1662098f4c41578ca8ef34382e5855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:07.893265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:07.893508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5e68-bd69-4b45-99d8-a4da8fbfb06c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.893945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:07.895605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 885/1786] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:07 2021] DELETE /identity/v3/projects/1b1662098f4c41578ca8ef34382e5855 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:07.896389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.897710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.942438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.943105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.943383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.943651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.945421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:07.958160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a95bb-40de-4611-bc50-0a99767a3848 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:07.962832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:07.963713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:07.964016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:07.964288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] PATH_INFO: `/v3/projects/3d81ee2cf8874793b34b5affac68472f/users/f49f0535ee0e40769f37a05268e74dbc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:07.978073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d81ee2cf8874793b34b5affac68472f, user_id=f49f0535ee0e40769f37a05268e74dbc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:07.980736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:07.994435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 886/1787] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:07 2021] PUT /identity/v3/projects/3d81ee2cf8874793b34b5affac68472f/users/f49f0535ee0e40769f37a05268e74dbc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:07.997726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:07.999335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.013502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.014984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.024270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 902/1788] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:07 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:08.025044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.034941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec8a3-37e9-478a-bcd9-0b567b3bf9df service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.070935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af24b-6a08-45d0-9b4f-8be5de89f71f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.078448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.079535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.079880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.080218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] PATH_INFO: `/v3/users/0a7e66356bff415c805f5ebfb04eb604` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.082135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7e66356bff415c805f5ebfb04eb604)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.084627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.101394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.102076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.102900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.103183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.103929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.105533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.116508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 903/1789] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:08 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:08.117331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.119862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.139694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7e66356bff415c805f5ebfb04eb604'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.151333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7e66356bff415c805f5ebfb04eb604'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.157884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7e66356bff415c805f5ebfb04eb604'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.158627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7e66356bff415c805f5ebfb04eb604'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.159251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7e66356bff415c805f5ebfb04eb604'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.172441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 887/1790] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:07 2021] DELETE /identity/v3/users/0a7e66356bff415c805f5ebfb04eb604 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:08.173404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.174235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c6b0-9811-4116-86c8-7f01a9b1dbd7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.175514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.222524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.223206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.223489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.223761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.225717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.258447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4e209-cdee-4888-a091-a07b2453a805 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.269059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.269959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.270238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.270507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] PATH_INFO: `/v3/projects/3d81ee2cf8874793b34b5affac68472f/users/f49f0535ee0e40769f37a05268e74dbc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.273471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d81ee2cf8874793b34b5affac68472f, user_id=f49f0535ee0e40769f37a05268e74dbc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.279093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cc690-b6ee-4c66-a2ca-388e094555b7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.298286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 888/1791] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:08 2021] PUT /identity/v3/projects/3d81ee2cf8874793b34b5affac68472f/users/f49f0535ee0e40769f37a05268e74dbc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:08.310336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.310771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.311517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.324400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.326120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.353373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 904/1792] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:08 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:08.355419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] MFA Rules not processed for user `f49f0535ee0e40769f37a05268e74dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:08.356879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.492652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 889/1793] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:08 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:08.504296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.505938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.519805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9fbec-40a7-4a99-9389-7b0825264775 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.527475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.529042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.596359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.596846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.597144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.597405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.606901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.607501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40395-aa60-4d6f-92cf-6af95b3a2aa2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.608342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.613291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.614224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.614504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.614819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] PATH_INFO: `/v3/projects/05d628d46ff14bef8c7637427fa5f2de` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.616019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d628d46ff14bef8c7637427fa5f2de)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.618446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.618910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 905/1794] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:08 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:08.682996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d628d46ff14bef8c7637427fa5f2de', 'request_id': 'req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.689105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d628d46ff14bef8c7637427fa5f2de', 'request_id': 'req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.695436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d628d46ff14bef8c7637427fa5f2de', 'request_id': 'req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.715706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] The token cache is being invalidate because project 05d628d46ff14bef8c7637427fa5f2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:08.716006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.716717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e8bcc447-2e3f-4df1-a757-4992d7b47d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:08.719649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 890/1795] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:08 2021] DELETE /identity/v3/projects/05d628d46ff14bef8c7637427fa5f2de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:08.720917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.722341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.725465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508cc5-c56e-48c9-8643-23a130b84b68 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.725776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508cc5-c56e-48c9-8643-23a130b84b68 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.726072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508cc5-c56e-48c9-8643-23a130b84b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.735111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615f7ca-31c7-4e0a-9bfe-9040e205e5c8 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.745039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-45508cc5-c56e-48c9-8643-23a130b84b68 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:08.746293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-45508cc5-c56e-48c9-8643-23a130b84b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.783585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.784332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.784617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.784898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.786717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.803143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 891/1796] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:08.810840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.811129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.811403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.829484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:08.830706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:08.838930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 892/1797] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:08.842947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.850777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.853070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.854066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4973c-18c2-463f-9d9d-7b93d2c13621 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.858960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.859618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.859897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.860172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.861509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:08.861818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.863447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.865231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 906/1798] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:08 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:08.880902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 893/1799] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:47:08.881755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.893108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255e79-2bbb-4f94-b8c2-34948e648d2b service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:08.898107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:08.898881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:08.899270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:08.899620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:08.900401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:08.902737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:08.934628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 907/1800] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:08 2021] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:08.935826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:08.947716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8993acb-f2d7-4fe1-822c-b337b316f3cf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.031856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.032906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.033541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.034059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.044797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.046795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.076481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 894/1801] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:08 2021] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:09.078187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.089828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf98a-8a86-4f7e-b9eb-c1c81b46e26b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.094796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.095582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.096025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.096366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.097276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.098981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.110408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 908/1802] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:09.114189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.124360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890fb1e-bb49-421b-a84b-c6bd106987e8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.129562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.130260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.130539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.130848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.131587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.133176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3efe9-15db-4818-b92a-1e7974869cc1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.144458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 895/1803] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:09.148764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.160429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d172-a573-41ec-b2df-b7da56b10de0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.170779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.170779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.170779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.171055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] PATH_INFO: `/v3/projects/da18bd7d429e4a5a944665afc670e9d4/users/09bdee1cf14f400f8e277a2855b5a4af/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.180999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da18bd7d429e4a5a944665afc670e9d4, user_id=09bdee1cf14f400f8e277a2855b5a4af, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.183726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.197136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 909/1804] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:09 2021] PUT /identity/v3/projects/da18bd7d429e4a5a944665afc670e9d4/users/09bdee1cf14f400f8e277a2855b5a4af/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:09.208897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.209384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.209672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.235918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] MFA Rules not processed for user `09bdee1cf14f400f8e277a2855b5a4af`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:09.237111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:09.296398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 896/1805] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:09 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:09.300859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.358886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcfe38-0c22-42bc-9e37-50c345a8b2b4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.363533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.364117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.364396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.364666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.365353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.367261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.395136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 910/1806] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:09 2021] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:09.399914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.410114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89819e4-6562-408b-9e05-7459a2198e8d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.462525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.463194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.463471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.463739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.464421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.466300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.486065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 897/1807] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:09 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:09.490275 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.501311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892266-3b6d-4b21-9924-7f7666720601 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.505881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.506581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.506864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.507138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.507868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.509484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.519936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 911/1808] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:09.524157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.534020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e524d32-79d9-41e3-a166-92f74ca88c16 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.538721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.539597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.540485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.540761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] PATH_INFO: `/v3/projects/e10316cd660d41f19a02aace91838a9a/users/ddaef1d3083b4ef085daaa7eb7a2241c/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.557305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10316cd660d41f19a02aace91838a9a, user_id=ddaef1d3083b4ef085daaa7eb7a2241c, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.560565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.573282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 898/1809] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:09 2021] PUT /identity/v3/projects/e10316cd660d41f19a02aace91838a9a/users/ddaef1d3083b4ef085daaa7eb7a2241c/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:09.577318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.587847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb1cc3-e04d-46d3-a4ac-af3653ead5ac admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.651766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.652438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.652723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.652993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.653729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.655349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636587c-9a9c-44c2-9ecb-cca1a9d6c608 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.672955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 912/1810] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:09.673824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.684314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d8c6b-fea5-4901-8242-15cd0c8a2556 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.689253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.690129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.690410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.690747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] PATH_INFO: `/v3/projects/e10316cd660d41f19a02aace91838a9a/users/ddaef1d3083b4ef085daaa7eb7a2241c/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.692730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10316cd660d41f19a02aace91838a9a, user_id=ddaef1d3083b4ef085daaa7eb7a2241c, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.695420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.706988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 899/1811] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:09 2021] PUT /identity/v3/projects/e10316cd660d41f19a02aace91838a9a/users/ddaef1d3083b4ef085daaa7eb7a2241c/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:09.717027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.717345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.717584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.744055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] MFA Rules not processed for user `ddaef1d3083b4ef085daaa7eb7a2241c`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:09.745324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:09.809990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 913/1812] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:09 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:09.819677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:09.822039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:09.876342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43febb40-0ef0-4ceb-b98b-8d6cba183582 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:09.879898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:09.880523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:09.880804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:09.881079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:09.890317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:09.891776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266ab1-67c2-411b-b157-96924139e0b4 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:09.901102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 900/1813] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:09 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:11.178651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:11.235749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9481e5-67e1-4530-a906-c4ca8f6876fd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:11.240360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:11.241218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:11.241491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:11.241765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] PATH_INFO: `/v3/users/09bdee1cf14f400f8e277a2855b5a4af` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:11.243041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09bdee1cf14f400f8e277a2855b5a4af)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:11.244972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:11.296213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09bdee1cf14f400f8e277a2855b5a4af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.303843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09bdee1cf14f400f8e277a2855b5a4af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.312173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09bdee1cf14f400f8e277a2855b5a4af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.326931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09bdee1cf14f400f8e277a2855b5a4af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.327657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09bdee1cf14f400f8e277a2855b5a4af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.333485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 914/1814] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:11 2021] DELETE /identity/v3/users/09bdee1cf14f400f8e277a2855b5a4af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:11.338285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:11.338851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:11.338955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:11.355653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:11.356975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:11.420918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 901/1815] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:11.431178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:11.432568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:11.491425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4b268-301b-4487-939a-e5cf179a886e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:11.495572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:11.496213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:11.496508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:11.496766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:11.505538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:11.506994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:11.516877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 915/1816] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:11.774886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:11.776374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:11.790313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23902139-2347-4b88-aa9c-e43446cb0b7e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:11.795010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:11.795897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:11.796951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:11.797550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] PATH_INFO: `/v3/projects/da18bd7d429e4a5a944665afc670e9d4` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:11.798830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da18bd7d429e4a5a944665afc670e9d4)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:11.800735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:11.851161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da18bd7d429e4a5a944665afc670e9d4', 'request_id': 'req-54262bb1-48bf-43f5-96c9-5a15c3074169'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.856405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da18bd7d429e4a5a944665afc670e9d4', 'request_id': 'req-54262bb1-48bf-43f5-96c9-5a15c3074169'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.862720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da18bd7d429e4a5a944665afc670e9d4', 'request_id': 'req-54262bb1-48bf-43f5-96c9-5a15c3074169'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.878847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] The token cache is being invalidate because project da18bd7d429e4a5a944665afc670e9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:11.878847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.879012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:11.880824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 902/1817] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:11 2021] DELETE /identity/v3/projects/da18bd7d429e4a5a944665afc670e9d4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:11.885040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:11.894320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc748-5e21-49f2-8f04-a3f2303988d6 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:11.950045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:11.950922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:11.951201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:11.951545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] PATH_INFO: `/v3/users/ddaef1d3083b4ef085daaa7eb7a2241c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:11.952693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddaef1d3083b4ef085daaa7eb7a2241c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:11.954713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.009659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddaef1d3083b4ef085daaa7eb7a2241c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.016749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddaef1d3083b4ef085daaa7eb7a2241c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.023775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddaef1d3083b4ef085daaa7eb7a2241c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.035175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddaef1d3083b4ef085daaa7eb7a2241c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.035865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3de9216d-f8c8-45bf-8362-431b9f1ac8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddaef1d3083b4ef085daaa7eb7a2241c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.041620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 916/1818] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:11 2021] DELETE /identity/v3/users/ddaef1d3083b4ef085daaa7eb7a2241c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:12.308119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.309605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:12.323932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262bb1-48bf-43f5-96c9-5a15c3074169 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.381740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.382614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.382893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.383164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] PATH_INFO: `/v3/projects/e10316cd660d41f19a02aace91838a9a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.384423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10316cd660d41f19a02aace91838a9a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.386303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.430136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10316cd660d41f19a02aace91838a9a', 'request_id': 'req-bae7d13e-d3d6-4503-bd4e-50415f6b160b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.435305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10316cd660d41f19a02aace91838a9a', 'request_id': 'req-bae7d13e-d3d6-4503-bd4e-50415f6b160b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.441116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10316cd660d41f19a02aace91838a9a', 'request_id': 'req-bae7d13e-d3d6-4503-bd4e-50415f6b160b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.453119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] The token cache is being invalidate because project e10316cd660d41f19a02aace91838a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:12.453397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.454013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bae7d13e-d3d6-4503-bd4e-50415f6b160b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:12.455545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 903/1819] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:12 2021] DELETE /identity/v3/projects/e10316cd660d41f19a02aace91838a9a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:12.463408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.463868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.463975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.481604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:12.482745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:12.543060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 917/1820] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:12.551048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.551339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.551654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.570278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:12.572105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:12.580182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 904/1821] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:12.584462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.594791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932487f-8e7b-4ec7-a8d7-937712fdfbb7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.599401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.600053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.600336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.600613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.601351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:12.601659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.603812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.615908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 918/1822] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:12.620851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.631748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dcb75-d315-4412-b273-15efdf133f51 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.637135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.637877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.638218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.638598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.639449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.641456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.667732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 905/1823] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:12 2021] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:12.671875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.682044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e2fd-d175-4ad9-a04b-5db658d66966 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.749166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.749983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.750266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.750828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.751569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.753470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.773883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 919/1824] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:12 2021] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:12.778363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.789147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2d0-3863-46e0-beae-98a4347c4ebe admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.794729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.794949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.795292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.795660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.796468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.798145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.809560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 906/1825] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:12.813486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.823553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1cef3-9f73-401f-82e6-9a8eba926e31 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.828608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.829363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.829651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.829925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.830711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.832291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd5a60-b471-4761-95b0-57c988cf7d9b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.846025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 920/1826] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:12.846712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:12.856548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf54e4-47a5-446b-ba24-298178590feb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:12.861007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:12.861871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.862146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.862413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] PATH_INFO: `/v3/projects/f5db9652da154b578a9caa79b0e543b4/users/de5e977886a64ba5a2b55a37165a8d26/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.876860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5db9652da154b578a9caa79b0e543b4, user_id=de5e977886a64ba5a2b55a37165a8d26, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:12.879541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:12.893468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 907/1827] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:12 2021] PUT /identity/v3/projects/f5db9652da154b578a9caa79b0e543b4/users/de5e977886a64ba5a2b55a37165a8d26/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:12.904908 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:12.905195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:12.905480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:12.934277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] MFA Rules not processed for user `de5e977886a64ba5a2b55a37165a8d26`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:12.935595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:13.012104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.012608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 921/1828] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:12 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:13.086393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566d18-2e10-41ff-876f-584e246ab50f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.092473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.092680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.093019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.093298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.094068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.096143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.126837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 908/1829] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:13 2021] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:13.130507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.143350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8fc8-906f-40a9-aee5-868c6c588ee1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.238202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.238948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.239230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.239501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.240704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.242127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.264784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 922/1830] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:13 2021] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:13.265948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.277990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2dd6-e08a-468c-aa37-95aef6d6b9ec admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.283562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.283845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.284124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.284411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.285137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.286752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.297452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 909/1831] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:13.302299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.312136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a31c1-5af2-4ba9-b4ca-e7b5743a5694 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.316895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.317764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.318076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.318329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] PATH_INFO: `/v3/projects/3e1b28f6bbfd47788954d00917d04446/users/3816221665574db3917254a60258a9c0/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.333663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1b28f6bbfd47788954d00917d04446, user_id=3816221665574db3917254a60258a9c0, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.336359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.349224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 923/1832] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:13 2021] PUT /identity/v3/projects/3e1b28f6bbfd47788954d00917d04446/users/3816221665574db3917254a60258a9c0/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:13.353623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.363806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4514-3ab7-4144-ac85-a11e2ddace8e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.429824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.430531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.430839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.431110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.431848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.433425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8086be-52ac-44ed-b616-9e6932832238 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.446967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 910/1833] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:13 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:13.447874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.457790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f404e-3187-4402-b9d6-979255e55490 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.462859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.463717 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.464287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.464287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] PATH_INFO: `/v3/projects/3e1b28f6bbfd47788954d00917d04446/users/3816221665574db3917254a60258a9c0/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.466172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1b28f6bbfd47788954d00917d04446, user_id=3816221665574db3917254a60258a9c0, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.468784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.479448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 924/1834] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:13 2021] PUT /identity/v3/projects/3e1b28f6bbfd47788954d00917d04446/users/3816221665574db3917254a60258a9c0/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:13.489872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.490366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.490698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.521026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] MFA Rules not processed for user `3816221665574db3917254a60258a9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:13.522402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:13.593068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 911/1835] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:13 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:13.603980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.606569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:13.662471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127834-f4a0-4c66-ad98-e95ab4ec2a8e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.666726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.667368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.667647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.667917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.676456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.677865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582e959-24bd-4a13-9bb9-3297bd933fd3 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.687231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 925/1836] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:13 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:13.874137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:13.884637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d3e5a-45ca-46a7-ab0c-e2dae6797d84 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:13.888264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:13.889030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:13.889305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:13.889533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:13.944516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:13.946519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf44568-f3a8-4680-878d-df6ff37a20da service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:13.955130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 912/1837] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:13 2021] GET /identity/v3/auth/tokens => generated 3425 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:14.698060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:14.699343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:14.700055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:14.702322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 926/1838] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:47:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:47:14.712373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:14.713214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:14.714015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:14.747073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:14.748708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:14.824259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 913/1839] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:47:14 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:14.838155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:14.839963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:14.873300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c1d1c-b44a-42e4-a2b2-545d3883b045 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:14.882354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:14.883336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:14.883782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:14.884134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:14.896343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:14.904300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8226b3-ac29-46c3-87c4-661081b2a38e service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:14.918928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 927/1840] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:15.897500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:15.900487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:15.964980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adddf-5ac2-4445-ac75-96a53f3b4d45 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:15.969634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:15.970495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:15.970805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:15.971081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] PATH_INFO: `/v3/users/1f8185f2b50349a1b5217f1009bac300` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:15.972307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8185f2b50349a1b5217f1009bac300)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:15.974818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.020764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8185f2b50349a1b5217f1009bac300'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.033232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8185f2b50349a1b5217f1009bac300'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.039900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8185f2b50349a1b5217f1009bac300'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.040428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8185f2b50349a1b5217f1009bac300'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.041019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8185f2b50349a1b5217f1009bac300'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.053308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 914/1841] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:15 2021] DELETE /identity/v3/users/1f8185f2b50349a1b5217f1009bac300 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:16.058324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.058842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.058950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.077436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:16.078776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.106741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.108527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.138800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 928/1842] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:16.148398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.150239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.170463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f7c-bbde-410b-8351-307b69f7a41f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.175082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.175945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.176224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.176497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] PATH_INFO: `/v3/users/5c6ca4df8f52424aa87876e2a41e45e1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.177721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6ca4df8f52424aa87876e2a41e45e1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.179668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.203553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125bf5-ab37-448a-99fa-399f2b7a8f24 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.207383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.208019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.208303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.208577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.217476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.218934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d48ee-dcbf-493e-afba-00f431a30188 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.222369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6ca4df8f52424aa87876e2a41e45e1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.228600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 929/1843] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:16.234311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6ca4df8f52424aa87876e2a41e45e1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.241089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6ca4df8f52424aa87876e2a41e45e1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.241825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6ca4df8f52424aa87876e2a41e45e1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.242610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6ca4df8f52424aa87876e2a41e45e1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.256673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 915/1844] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:16 2021] DELETE /identity/v3/users/5c6ca4df8f52424aa87876e2a41e45e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:16.261711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.262053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.262443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.282622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:16.283942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.360635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 930/1845] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:16.370512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.372084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.428725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3837-a469-483d-a336-1f0af837b87f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.432983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.433630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.433918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.434193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.443795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.446537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.457553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 916/1846] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:16.637271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.639044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.651715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.653178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.656024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09fdde-f9ce-46e2-8dd8-7b536451ba3f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.661306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.662316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.662611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.663210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] PATH_INFO: `/v3/users/caabc2fa3ab446378be10b6220054828` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.664529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caabc2fa3ab446378be10b6220054828)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.666922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.669868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5af13-c737-4485-910a-11232ec0c523 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.676338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.677198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.677919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.678219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] PATH_INFO: `/v3/projects/f2743289049242c6ac65ceb2d6d7587f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.680019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2743289049242c6ac65ceb2d6d7587f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.682974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.726199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caabc2fa3ab446378be10b6220054828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.735649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caabc2fa3ab446378be10b6220054828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.744388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caabc2fa3ab446378be10b6220054828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.755802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2743289049242c6ac65ceb2d6d7587f', 'request_id': 'req-c0bd0ce3-5149-4294-a945-3f3024233536'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.760674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caabc2fa3ab446378be10b6220054828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.761564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2743289049242c6ac65ceb2d6d7587f', 'request_id': 'req-c0bd0ce3-5149-4294-a945-3f3024233536'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.762757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-390d7050-18e9-41de-b9ae-d3f6b95bb935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caabc2fa3ab446378be10b6220054828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.769115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 931/1847] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:16 2021] DELETE /identity/v3/users/caabc2fa3ab446378be10b6220054828 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:16.769251 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2743289049242c6ac65ceb2d6d7587f', 'request_id': 'req-c0bd0ce3-5149-4294-a945-3f3024233536'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.773227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.774739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.775075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.784789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] The token cache is being invalidate because project f2743289049242c6ac65ceb2d6d7587f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:16.785089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.785735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.787937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 917/1848] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:16 2021] DELETE /identity/v3/projects/f2743289049242c6ac65ceb2d6d7587f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:16.791578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.793707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.797578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:16.798982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.869939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 932/1849] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:16.871015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.872444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:16.886575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6fc83-ed39-48b1-b308-569636bb7a4d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.890864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd0ce3-5149-4294-a945-3f3024233536 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:16.891863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.894079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.894079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.894079 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] PATH_INFO: `/v3/projects/120f6449849a43b29648022ae43b30c7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.895336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120f6449849a43b29648022ae43b30c7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.897431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.898332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:16.900006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:16.900474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:16.900750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] PATH_INFO: `/v3/users/1427de85d2ca4e798e166171652ca9f4` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:16.902402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1427de85d2ca4e798e166171652ca9f4)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:16.904673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:16.953464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120f6449849a43b29648022ae43b30c7', 'request_id': 'req-4d47ea35-63f8-4303-9920-d99911f712b7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.958851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1427de85d2ca4e798e166171652ca9f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.961094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120f6449849a43b29648022ae43b30c7', 'request_id': 'req-4d47ea35-63f8-4303-9920-d99911f712b7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.969256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120f6449849a43b29648022ae43b30c7', 'request_id': 'req-4d47ea35-63f8-4303-9920-d99911f712b7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.970198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1427de85d2ca4e798e166171652ca9f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.982872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] The token cache is being invalidate because project 120f6449849a43b29648022ae43b30c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:16.983159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.983834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.984521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1427de85d2ca4e798e166171652ca9f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.985292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1427de85d2ca4e798e166171652ca9f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.985735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 933/1850] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:16 2021] DELETE /identity/v3/projects/120f6449849a43b29648022ae43b30c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:16.987136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1427de85d2ca4e798e166171652ca9f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:16.989505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:16.990923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.007655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 918/1851] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:16 2021] DELETE /identity/v3/users/1427de85d2ca4e798e166171652ca9f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:17.009420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.021973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.066153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ea35-63f8-4303-9920-d99911f712b7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.125007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50cee-465a-4e40-9624-ae8d2c5fb192 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.131316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.132369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.132910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.133191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.134094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] PATH_INFO: `/v3/users/f49f0535ee0e40769f37a05268e74dbc` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.134622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.135321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.135614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49f0535ee0e40769f37a05268e74dbc)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.135736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.137751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.138318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.154387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.156491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.168173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 934/1852] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:17.192989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49f0535ee0e40769f37a05268e74dbc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.205973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49f0535ee0e40769f37a05268e74dbc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.214248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49f0535ee0e40769f37a05268e74dbc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.215538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49f0535ee0e40769f37a05268e74dbc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.216095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e9d2911-e885-48e2-b8d1-a3cdc17f2993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49f0535ee0e40769f37a05268e74dbc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.232329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 919/1853] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:17 2021] DELETE /identity/v3/users/f49f0535ee0e40769f37a05268e74dbc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:17.340126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.341757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.355841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0fe43-8033-4d56-9ab6-e10482e45df0 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.424663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.425523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.425947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.426380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] PATH_INFO: `/v3/projects/e05b10c0e41841e0b908562e5a79508f` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.427780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05b10c0e41841e0b908562e5a79508f)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.429670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.485984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05b10c0e41841e0b908562e5a79508f', 'request_id': 'req-c6027003-abee-42c1-8465-db0442a6ae9d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.494681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05b10c0e41841e0b908562e5a79508f', 'request_id': 'req-c6027003-abee-42c1-8465-db0442a6ae9d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.503669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05b10c0e41841e0b908562e5a79508f', 'request_id': 'req-c6027003-abee-42c1-8465-db0442a6ae9d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.516852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] The token cache is being invalidate because project e05b10c0e41841e0b908562e5a79508f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:17.517349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.518025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.519572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 935/1854] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:17 2021] DELETE /identity/v3/projects/e05b10c0e41841e0b908562e5a79508f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:17.527565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.527565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.527565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.528765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.530278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.547228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:17.548394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.635903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 920/1855] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:17.641662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.647472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.664191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b54bc-62db-4581-8fcd-7f599381a86a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.687272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.687600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6027003-abee-42c1-8465-db0442a6ae9d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.690351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.690817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.691050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] PATH_INFO: `/v3/projects/3d81ee2cf8874793b34b5affac68472f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.692381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d81ee2cf8874793b34b5affac68472f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.692880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.694441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.694733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.695091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.695457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] PATH_INFO: `/v3/projects/d79b6b942fc748049e75f83fe647113f` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.697433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79b6b942fc748049e75f83fe647113f)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.699453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.748547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d81ee2cf8874793b34b5affac68472f', 'request_id': 'req-9daab81d-4a4a-401a-a67f-c11b73017d02'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.749875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79b6b942fc748049e75f83fe647113f', 'request_id': 'req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.755882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d81ee2cf8874793b34b5affac68472f', 'request_id': 'req-9daab81d-4a4a-401a-a67f-c11b73017d02'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.756735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79b6b942fc748049e75f83fe647113f', 'request_id': 'req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.764081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d81ee2cf8874793b34b5affac68472f', 'request_id': 'req-9daab81d-4a4a-401a-a67f-c11b73017d02'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.765002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79b6b942fc748049e75f83fe647113f', 'request_id': 'req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.779530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] The token cache is being invalidate because project d79b6b942fc748049e75f83fe647113f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:17.779821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.780581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8ae36728-40b8-47fc-8b32-ebd2d9aa9a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.781668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] The token cache is being invalidate because project 3d81ee2cf8874793b34b5affac68472f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:17.782203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 936/1856] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:17 2021] DELETE /identity/v3/projects/d79b6b942fc748049e75f83fe647113f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:17.786524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbe23-bfe6-4b95-9bfd-0053a0ab03f0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.786848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbe23-bfe6-4b95-9bfd-0053a0ab03f0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.787128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cbe23-bfe6-4b95-9bfd-0053a0ab03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.790072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.791299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.793205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 921/1857] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:17 2021] DELETE /identity/v3/projects/3d81ee2cf8874793b34b5affac68472f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:17.794411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.796388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.806580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b71cbe23-bfe6-4b95-9bfd-0053a0ab03f0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:17.807810 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b71cbe23-bfe6-4b95-9bfd-0053a0ab03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.868132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 937/1858] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:17.869410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.869700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.869978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.879765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab81d-4a4a-401a-a67f-c11b73017d02 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.884948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.885805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.886075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.886343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] PATH_INFO: `/v3/users/75b2119f16484fce98dbffd3745d7184` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.887573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b2119f16484fce98dbffd3745d7184)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.887932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:17.889117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.889465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.897307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 938/1859] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:17.897886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.907583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9697-8feb-4b15-8d35-f306201e36b9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:17.912741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:17.913595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.913887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.914260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.915300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:17.915615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:17.917503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6040a-0003-4463-9f93-a1d6f7457fa2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:17.929322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 939/1860] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:17.930938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:17.931373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:17.931641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:17.935428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b2119f16484fce98dbffd3745d7184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.947276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b2119f16484fce98dbffd3745d7184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.949251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:17.950443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.953827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b2119f16484fce98dbffd3745d7184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.960828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b2119f16484fce98dbffd3745d7184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.960828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b2119f16484fce98dbffd3745d7184'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:17.966039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 940/1861] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:17.969347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.969347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:17.969553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 922/1862] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:17 2021] DELETE /identity/v3/users/75b2119f16484fce98dbffd3745d7184 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:17.973116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:17.980958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc1d30-a872-4635-8349-0896358d4296 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.041603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bd26-80da-4294-bf74-f4a807a93255 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.042991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.043654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.043955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.044249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.044975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.046988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.048962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.049757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.049941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.050356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.051137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:18.051443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.053095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.069984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 923/1863] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:47:18.071121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.077528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 941/1864] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:17 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.078503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.080729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606ba3a-1f36-43c7-b8df-d4658b3fefaa admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.148917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfcb02-c3ff-4b43-9a64-7dda965af43c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.149304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.150675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.151028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.151846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.152704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.153926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.154632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.154912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.155375 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.155760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.156560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.158860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.189465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 942/1865] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:18.193559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.195725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 924/1866] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:18.201301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.206939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff80a0-9859-41f8-b0f0-af9d31f3cb87 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.274604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.275302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.275748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.276030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.276781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.278350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cb04f-7549-4145-8784-9e437870364d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.278490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.284336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.285010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.285288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.285562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.286269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.288220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.291785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 943/1867] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:18.295391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.307198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649f2d-8f1b-4512-92cd-30f6e8cf392b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.313903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 925/1868] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.314054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.314054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.314054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.314302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.315013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.315190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.316839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.326576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ccd9-c817-4cb5-b855-6a8252d95eec admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.329438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 944/1869] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:18.333692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.335353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.336154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.336573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.336924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.337797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.339757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.345888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377880d-4d3d-496e-aa9a-196a60e84dcb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.353151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 926/1870] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:18.356105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.356991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.357372 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.357714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.358065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] PATH_INFO: `/v3/projects/89a1317d772d4adeaafa14bbea12560c/users/5da0ac15c4b84aacb7f102d9442510f5/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.368318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e567e-e01b-48ae-900f-e120b336d29e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.373599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.374286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.374959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.375227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.376222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.377864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.379256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a1317d772d4adeaafa14bbea12560c, user_id=5da0ac15c4b84aacb7f102d9442510f5, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.382146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.390792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 927/1871] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:18.395859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.401944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 945/1872] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:18 2021] PUT /identity/v3/projects/89a1317d772d4adeaafa14bbea12560c/users/5da0ac15c4b84aacb7f102d9442510f5/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:18.409648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.412704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.416668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f95b-8ff8-4b24-906a-ec51a7d6efdc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.480022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.480902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.481182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.481456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] PATH_INFO: `/v3/projects/baadf91abe234aac8ab4fdd264dfb973/users/72d53f06fed24b938366fe01c7fd23d8/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.492317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd4ae4-abb6-4c83-9028-a28d26af2f9a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.495283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=baadf91abe234aac8ab4fdd264dfb973, user_id=72d53f06fed24b938366fe01c7fd23d8, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.497147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.497962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7162-1fc2-40ac-b37a-77b1bec90dde admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.498071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.498238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.498507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] PATH_INFO: `/v3/projects/3fd4dcb59eb1457291e82e588e922044` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.499712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd4dcb59eb1457291e82e588e922044)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.501850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.511259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 928/1873] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:18 2021] PUT /identity/v3/projects/baadf91abe234aac8ab4fdd264dfb973/users/72d53f06fed24b938366fe01c7fd23d8/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:18.512516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d29f3-761f-4a2d-8ec6-572a01610fd9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.512804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d29f3-761f-4a2d-8ec6-572a01610fd9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.513099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d29f3-761f-4a2d-8ec6-572a01610fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.544979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-158d29f3-761f-4a2d-8ec6-572a01610fd9 None None] MFA Rules not processed for user `5da0ac15c4b84aacb7f102d9442510f5`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:18.546100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-158d29f3-761f-4a2d-8ec6-572a01610fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.547788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd4dcb59eb1457291e82e588e922044', 'request_id': 'req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:18.552990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd4dcb59eb1457291e82e588e922044', 'request_id': 'req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:18.561246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd4dcb59eb1457291e82e588e922044', 'request_id': 'req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:18.572541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] The token cache is being invalidate because project 3fd4dcb59eb1457291e82e588e922044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:18.572832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:18.573486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e501bf5c-5ac6-45b0-b084-c574d9edc8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:18.575070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 946/1874] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:18 2021] DELETE /identity/v3/projects/3fd4dcb59eb1457291e82e588e922044 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:18.576298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.576588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.576869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.603124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] MFA Rules not processed for user `72d53f06fed24b938366fe01c7fd23d8`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:18.604339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.611085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 929/1875] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:18.614674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.614674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.614674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.630866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:18.632034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.673429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 947/1876] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:18.673877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.676008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.691434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 930/1877] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:18.692317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.693608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.705562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577872-a18e-4bad-ac80-244fb2602e42 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.710648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.711288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.711632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.711909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.712604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.714502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1b40f-2784-4dbd-bc4f-8b427ca2e142 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.737944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1669-af3c-4ad8-b7b2-d3765ba2e017 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.742314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 931/1878] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.742314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.742314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.742314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.759396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:18.760562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:18.792063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.792719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.793001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.793277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.793976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.796014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.817729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 932/1879] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:18.818704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.820349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 948/1880] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.822588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.828604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f514da-7ae0-4318-96ca-45beaef9736b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.880690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5149-b7ff-4ca3-85d1-269d0513725b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.883860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.884440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.884721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.884999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.885699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.887526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.887652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.888194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.888472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.888749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.889490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:18.889794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.891396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.907757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 949/1881] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:18.907757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.911986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 933/1882] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.912871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.919096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aff3d-8633-4786-8c4c-d28e783beb53 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.923709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098c8e2-1dff-4957-bfdf-cb7e031c1bf1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.923880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.924516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.924794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.925073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.925778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.927730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.929216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:18.929875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:18.930186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:18.930462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:18.931197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:18.933226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:18.949095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 950/1883] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/users => generated 299 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.951479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:18.962786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab214b-35d7-4932-af64-be1040f0003c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:18.967151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 934/1884] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:18 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:18.967151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.032423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.033857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.034324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.034834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.036138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.038811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.050261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 951/1885] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.051576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.054990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fc248-2f1c-4132-bc85-6bf2fc174cfc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.061867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85208-dc61-44ce-b6bd-5ee0aea8469b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.062758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.063432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.063713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.063985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.064786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.066315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.066415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.067096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.067379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.068270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.068377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.070395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.078269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 935/1886] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.079455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.091490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4378f7-f037-4e25-843e-7bdee9e5c74f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.097223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.097923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.098324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.098700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.099632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.100988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 952/1887] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:19.101441 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.101517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.112053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 936/1888] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.113252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.114400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5cc9-5d14-4b72-9bb8-e8ec7a139e09 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.121513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.122570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.122910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.123264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] PATH_INFO: `/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6/users/a445747e41b64fbbae7b0e7547d8a10d/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.124734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ae2f-98ab-4be7-a9b9-76b05c363807 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.129590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.130229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.130509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.130813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.131544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.133154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.138735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bde617ea4b4b2a8516cb4c870b92d6, user_id=a445747e41b64fbbae7b0e7547d8a10d, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.141761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.142839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 937/1889] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.143667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.155642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113298a9-0537-4fd8-916d-d759ee67fbce admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.155783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 953/1890] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6/users/a445747e41b64fbbae7b0e7547d8a10d/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:19.156266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.209519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.210512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.210823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.211105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] PATH_INFO: `/v3/projects/ace9e34006de4a9cb8f862387a54cb0b/users/014426407830442bb2e9190996dbcbf2/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.213341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480cf1-a8e9-4cf9-9332-5f4b635188b3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.217917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.218584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.218868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.219141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.219871 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.221452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.225131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace9e34006de4a9cb8f862387a54cb0b, user_id=014426407830442bb2e9190996dbcbf2, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.228338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.231494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 954/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.232427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.242225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56ff-a839-461b-8bfa-34119cb448ab admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.243933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 938/1892] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/ace9e34006de4a9cb8f862387a54cb0b/users/014426407830442bb2e9190996dbcbf2/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:19.244778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.296334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.297002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.297280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.297738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.298691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.300475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d1871-916b-443f-ad13-f5e65bf1df08 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.304588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ae0f1-098f-4940-a417-2b3b826ec344 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.310748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.311359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 955/1893] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.311712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.312059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.312343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] PATH_INFO: `/v3/projects/934bef09bef342268c374dee0d230c8b/users/18d9d8aa24734e19b54f8ff3d1580508/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.312463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7847-cb71-4b6a-bd73-778133325ede None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.312776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7847-cb71-4b6a-bd73-778133325ede None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.313060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc7847-cb71-4b6a-bd73-778133325ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.327447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934bef09bef342268c374dee0d230c8b, user_id=18d9d8aa24734e19b54f8ff3d1580508, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.330093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.339422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3cdc7847-cb71-4b6a-bd73-778133325ede None None] MFA Rules not processed for user `014426407830442bb2e9190996dbcbf2`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:19.340606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3cdc7847-cb71-4b6a-bd73-778133325ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:19.347508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 939/1894] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/934bef09bef342268c374dee0d230c8b/users/18d9d8aa24734e19b54f8ff3d1580508/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:19.348356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.404182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 956/1895] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:19.405586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33530-be21-46da-87fb-13829f8c4388 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.405876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33530-be21-46da-87fb-13829f8c4388 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.406152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33530-be21-46da-87fb-13829f8c4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.408675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1bc1-c83c-4993-b91b-d5c0a3c810b3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.413330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.414199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.415048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.415456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] PATH_INFO: `/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6/users/a445747e41b64fbbae7b0e7547d8a10d/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.417478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bde617ea4b4b2a8516cb4c870b92d6, user_id=a445747e41b64fbbae7b0e7547d8a10d, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.420143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.430934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 940/1896] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6/users/a445747e41b64fbbae7b0e7547d8a10d/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:19.431900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.433424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8ef33530-be21-46da-87fb-13829f8c4388 None None] MFA Rules not processed for user `18d9d8aa24734e19b54f8ff3d1580508`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:19.434668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8ef33530-be21-46da-87fb-13829f8c4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:19.505581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c174ce-4ebb-4349-ae8e-c70a1774fc38 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.505990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 957/1897] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:19.510090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.510090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.510090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.512051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.512717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.512996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.513347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.514051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.516215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.542307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] MFA Rules not processed for user `a445747e41b64fbbae7b0e7547d8a10d`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:19.543570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:19.549173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 941/1898] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:19.550352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.552395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:19.612979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f940d3-c775-4f1c-9059-adc10006f84a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.616748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.617393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.618191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.618463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.635658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 958/1899] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:19.635658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.645868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b15f2b-b7b9-4e13-9cab-83200fe564f7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.690402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.691882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.701292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 942/1900] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:19.702075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.703485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:19.704328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.704997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.705281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.705650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.706349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.708463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.714234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639a89-1290-49a1-851d-180a42784492 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.718070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.718729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.719021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.719287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.729446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 959/1901] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:19.733235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.743465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22b83-e2d8-49ee-b139-dba1eba1af2c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.748408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.749061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.749342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.749644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.750653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.752235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.763025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 960/1902] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:19.766803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.777167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58323a-3b1e-4e9a-949f-0fb5ddfa6284 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.782299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.783332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.783515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.783748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] PATH_INFO: `/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8/users/ff73d4d827a744e19f0fa9f968f6c7e7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.786951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.788404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.798348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 943/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:19.800708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd94b8cf19f143a9b8a3448af5a168c8, user_id=ff73d4d827a744e19f0fa9f968f6c7e7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.803582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.827193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 961/1904] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8/users/ff73d4d827a744e19f0fa9f968f6c7e7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:19.833573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.844716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc634-51cd-400f-b723-b43462c7a2ed service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.882128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.906983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.907656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.907940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.908215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.908962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.910600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.923619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 944/1905] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:19 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:19.927560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:19.938043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40be13-bf76-4f5e-ad8f-f55f1c4e6e7a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.943579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.944121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.944402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.944686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] PATH_INFO: `/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8/users/ff73d4d827a744e19f0fa9f968f6c7e7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.947444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd94b8cf19f143a9b8a3448af5a168c8, user_id=ff73d4d827a744e19f0fa9f968f6c7e7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.948959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6166e-379e-47e3-86fa-a483e8721f05 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:19.950009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb44ae-39ad-47f3-9d98-1c55d9fc17e4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.962669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:19.963964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.964312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.964973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] PATH_INFO: `/v3/users/5da0ac15c4b84aacb7f102d9442510f5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:19.967101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da0ac15c4b84aacb7f102d9442510f5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:19.967222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 945/1906] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:19 2021] PUT /identity/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8/users/ff73d4d827a744e19f0fa9f968f6c7e7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:19.971068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:19.978355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:19.978669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:19.978952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.011773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] MFA Rules not processed for user `ff73d4d827a744e19f0fa9f968f6c7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:20.013228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.038242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da0ac15c4b84aacb7f102d9442510f5'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.049351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da0ac15c4b84aacb7f102d9442510f5'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.058580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da0ac15c4b84aacb7f102d9442510f5'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.070026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da0ac15c4b84aacb7f102d9442510f5'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.071280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-76608d1b-fc5f-462d-b71b-d0bb00e1939a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da0ac15c4b84aacb7f102d9442510f5'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.078420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 962/1907] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:19 2021] DELETE /identity/v3/users/5da0ac15c4b84aacb7f102d9442510f5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:20.082831 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:20.083101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:20.083380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.087633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 946/1908] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:19 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:20.097969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:20.099422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.102519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:20.103703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.159705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc0d2-5fbd-44b7-b567-fb32de38a002 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:20.168290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 963/1909] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:20.178461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:20.179855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.217828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:20.218492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:20.218803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:20.219774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.243511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b21cf2-a569-49ac-bd17-83a2be6ee787 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:20.248779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:20.249437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:20.249716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:20.250064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.261451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:20.262948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:20.274639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 964/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:20.286602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:20.288174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:20.299553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 947/1911] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:20 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:20.361154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:20.362708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.375727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79303a8-62d1-4a37-9c86-da79deb52962 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:20.381185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:20.383000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:20.383458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:20.383855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.387163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.487201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:20.496634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:20.509812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 965/1912] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:20 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:20.817289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:20.817700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:20.834613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff134a6-0bf9-412b-b6ba-ec83c69b899e service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:20.840785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:20.842060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:20.842410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:20.842808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] PATH_INFO: `/v3/projects/89a1317d772d4adeaafa14bbea12560c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:20.844261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a1317d772d4adeaafa14bbea12560c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:20.846895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:20.922087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a1317d772d4adeaafa14bbea12560c', 'request_id': 'req-a484c685-6a39-4f3c-aff3-5110b917d8b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.929049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a1317d772d4adeaafa14bbea12560c', 'request_id': 'req-a484c685-6a39-4f3c-aff3-5110b917d8b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.943415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a1317d772d4adeaafa14bbea12560c', 'request_id': 'req-a484c685-6a39-4f3c-aff3-5110b917d8b6'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.960816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] The token cache is being invalidate because project 89a1317d772d4adeaafa14bbea12560c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:20.961334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.963348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:20.965755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 948/1913] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:20 2021] DELETE /identity/v3/projects/89a1317d772d4adeaafa14bbea12560c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:20.969973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:20.984016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96dfa9-d086-4469-a39c-d13ab60e8191 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:21.089464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:21.090476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.090793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.091070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] PATH_INFO: `/v3/users/a445747e41b64fbbae7b0e7547d8a10d` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.098760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a445747e41b64fbbae7b0e7547d8a10d)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:21.100907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:21.155870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a445747e41b64fbbae7b0e7547d8a10d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.164164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a445747e41b64fbbae7b0e7547d8a10d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.172545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a445747e41b64fbbae7b0e7547d8a10d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.185219 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a445747e41b64fbbae7b0e7547d8a10d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.185936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-43af1212-df1b-4761-8308-211c49a27075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a445747e41b64fbbae7b0e7547d8a10d'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.191722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 966/1914] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:20 2021] DELETE /identity/v3/users/a445747e41b64fbbae7b0e7547d8a10d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:21.491669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:21.493834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:21.509245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484c685-6a39-4f3c-aff3-5110b917d8b6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:21.584599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:21.585518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.585807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.586109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] PATH_INFO: `/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.587604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bde617ea4b4b2a8516cb4c870b92d6)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:21.589576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:21.651925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bde617ea4b4b2a8516cb4c870b92d6', 'request_id': 'req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.662680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bde617ea4b4b2a8516cb4c870b92d6', 'request_id': 'req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.667132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bde617ea4b4b2a8516cb4c870b92d6', 'request_id': 'req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.683976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] The token cache is being invalidate because project b3bde617ea4b4b2a8516cb4c870b92d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:21.684445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.685255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-672b1ae9-4730-43b9-bfd9-ba6f47bbd6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:21.687522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 949/1915] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:21 2021] DELETE /identity/v3/projects/b3bde617ea4b4b2a8516cb4c870b92d6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:21.692933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.693386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.693797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.725183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:21.726399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:21.784980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 967/1916] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:21.793728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.794015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.794294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.813236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:21.814466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:21.822965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 950/1917] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:21.827119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:21.836535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96578f3-9bbb-4138-83e2-c38d26977934 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:21.841056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:21.841695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.841974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.842247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.843018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:21.843318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:21.844893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:21.855865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 968/1918] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:21.859833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:21.869330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35053a9-b6a9-46d5-99e0-07609190a16f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:21.874084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:21.874756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.875038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.875317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.876267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:21.878133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:21.903599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 951/1919] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:21 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:21.907771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:21.917638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f3095-f166-4c84-b6c3-79d06e1f40e3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:21.971702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:21.972372 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:21.972653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:21.972935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:21.973643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:21.979119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:21.997194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 969/1920] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:21 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:22.001631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.012898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86d15-d650-4f38-8c69-da0da84d9995 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.018531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.019218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.019504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.019788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.020648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.022593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.034106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 952/1921] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:22.038172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.048796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab507c5-2853-429b-92c4-8729d8e7c98c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.055739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.056615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.056906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.057215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.057999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.059603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e5de8-05db-40b8-a37b-6e64481b3b0d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.070596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 970/1922] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:22.074687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.089193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef719c-c0a5-4c29-8356-037c090abd60 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.102311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.103509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.103859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.104223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] PATH_INFO: `/v3/projects/a9e1ff586d4c47b0b281fdc5799b185a/users/e67a8531f3a340928f0f9260558a6106/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.122357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e1ff586d4c47b0b281fdc5799b185a, user_id=e67a8531f3a340928f0f9260558a6106, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.125271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.154632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 953/1923] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:22 2021] PUT /identity/v3/projects/a9e1ff586d4c47b0b281fdc5799b185a/users/e67a8531f3a340928f0f9260558a6106/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:22.161276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.161786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.161881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.191639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] MFA Rules not processed for user `e67a8531f3a340928f0f9260558a6106`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:22.192846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:22.269744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 971/1924] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:22 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:22.274255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.347932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f9c5-0ef4-474c-b01e-e10b14437b4d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.354316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.355038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.355307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.355576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.356315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.358205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.384109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 954/1925] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:22 2021] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:22.389728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.400755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcffa14-5450-4d62-b395-db599d3cf849 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.456748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.457416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.457700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.457978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.458734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.460709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.482329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 972/1926] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:22 2021] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:22.486535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.501240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08367-8b07-4d99-83d1-a12c1c10415d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.506231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.506979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.507261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.507535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.508308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.509964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.522082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 955/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:22.526755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.537006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c3f03-b583-4485-a659-b207bba63406 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.542385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.543313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.543607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.543887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] PATH_INFO: `/v3/projects/56514e24612749e2ac5a700df1221f83/users/ae490813a2ac4681acc0daaf95d30d8f/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.560237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56514e24612749e2ac5a700df1221f83, user_id=ae490813a2ac4681acc0daaf95d30d8f, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.563114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.576958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 973/1928] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:22 2021] PUT /identity/v3/projects/56514e24612749e2ac5a700df1221f83/users/ae490813a2ac4681acc0daaf95d30d8f/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:22.581126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.591182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e9e0-1dee-4aeb-a89b-95603bad99ff admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.645034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.645719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.646011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.646295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.647043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.648692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1b08-4e94-4781-8aea-7106f26ad367 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.658256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 956/1929] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:22 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:22.662558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.672940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ea7d-761f-4659-aab3-3e0e15a33376 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.678416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.679340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.679625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.679945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] PATH_INFO: `/v3/projects/56514e24612749e2ac5a700df1221f83/users/ae490813a2ac4681acc0daaf95d30d8f/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.682459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56514e24612749e2ac5a700df1221f83, user_id=ae490813a2ac4681acc0daaf95d30d8f, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.685216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.695515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 974/1930] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:22 2021] PUT /identity/v3/projects/56514e24612749e2ac5a700df1221f83/users/ae490813a2ac4681acc0daaf95d30d8f/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:22.709286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.709776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.710117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.746454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] MFA Rules not processed for user `ae490813a2ac4681acc0daaf95d30d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:22.747816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:22.788794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.793206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:22.821395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 957/1931] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:22 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:22.831372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:22.832729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:22.866959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3781-a7d1-444c-ae07-0e145aecad7b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.873014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.874004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.874289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.874991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] PATH_INFO: `/v3/users/18d9d8aa24734e19b54f8ff3d1580508` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.876109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d9d8aa24734e19b54f8ff3d1580508)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.878012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.891742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27709-3b74-48be-8751-0380b49e0f67 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:22.895841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:22.896489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.896765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.897048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.912421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:22.915983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c749-a2af-4b4b-99d6-33966c9c86c2 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:22.925136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 958/1932] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:22 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:22.937051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d9d8aa24734e19b54f8ff3d1580508'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:22.944352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d9d8aa24734e19b54f8ff3d1580508'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:22.951805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d9d8aa24734e19b54f8ff3d1580508'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:22.963859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d9d8aa24734e19b54f8ff3d1580508'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:22.964608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d9d8aa24734e19b54f8ff3d1580508'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:22.970509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 975/1933] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:22 2021] DELETE /identity/v3/users/18d9d8aa24734e19b54f8ff3d1580508 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:22.976201 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:22.976490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:22.976765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:22.996356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:22.997550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.027366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.028790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.056549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 959/1934] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:23.066399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.067798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.084058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4b56-14c0-4a2f-9b49-c19ee2b36a67 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.088325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.088969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.089247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.089525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.091330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.123026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609120ca-78bc-4bf8-a861-5853db62267a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.126815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.127457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.127746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.128044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.140003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.141433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.149102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.150523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.151048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 960/1935] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:23.160103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 976/1936] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:23 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:23.522343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.524903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.549650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34760-5703-49c3-af5a-e2480859c969 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.556218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.557568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.558124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.558846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] PATH_INFO: `/v3/users/72d53f06fed24b938366fe01c7fd23d8` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.561329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d53f06fed24b938366fe01c7fd23d8)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.564562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.569234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.577263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.596504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6847b8-1023-4727-af53-eeded797e122 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.603964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.604861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.605215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.605492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] PATH_INFO: `/v3/projects/934bef09bef342268c374dee0d230c8b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.606811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934bef09bef342268c374dee0d230c8b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.608813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.679223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d53f06fed24b938366fe01c7fd23d8'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.700406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934bef09bef342268c374dee0d230c8b', 'request_id': 'req-727e068a-6945-408f-ba04-9904c2a4c5a0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.708302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d53f06fed24b938366fe01c7fd23d8'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.714020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934bef09bef342268c374dee0d230c8b', 'request_id': 'req-727e068a-6945-408f-ba04-9904c2a4c5a0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.719495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d53f06fed24b938366fe01c7fd23d8'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.720294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d53f06fed24b938366fe01c7fd23d8'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.720904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ff2e821e-25bb-483a-a489-a83017a28145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d53f06fed24b938366fe01c7fd23d8'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.724074 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934bef09bef342268c374dee0d230c8b', 'request_id': 'req-727e068a-6945-408f-ba04-9904c2a4c5a0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.733769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 961/1937] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:23 2021] DELETE /identity/v3/users/72d53f06fed24b938366fe01c7fd23d8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:23.736785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] The token cache is being invalidate because project 934bef09bef342268c374dee0d230c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:23.736958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.737659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727e068a-6945-408f-ba04-9904c2a4c5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.738135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.738425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.738741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.739740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 977/1938] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:23 2021] DELETE /identity/v3/projects/934bef09bef342268c374dee0d230c8b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:23.756034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.756429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.756800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.757358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:23.759100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.786492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:23.787977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.822249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 962/1939] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:23.826202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.827641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.842149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f0ebe-ef90-4542-999d-5756370cbd76 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.847206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.848260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.848540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.849037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] PATH_INFO: `/v3/users/de5e977886a64ba5a2b55a37165a8d26` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.850231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 978/1940] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:23.850362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5e977886a64ba5a2b55a37165a8d26)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.851209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:23.852268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.852676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.905864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5e977886a64ba5a2b55a37165a8d26'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.911570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49291c2-3cda-4ba4-ac99-445a9814f99b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:23.916446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:23.917402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.917683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.918025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.920491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5e977886a64ba5a2b55a37165a8d26'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.927200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5e977886a64ba5a2b55a37165a8d26'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.927912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5e977886a64ba5a2b55a37165a8d26'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.928525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5aad7642-a8a9-4954-adb5-45cea89418c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5e977886a64ba5a2b55a37165a8d26'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:23.928633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:23.930313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b652-2849-46b1-9096-a6c05183b93d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:23.942646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 979/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:23.944190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.946739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.946739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.956219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 963/1942] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:23 2021] DELETE /identity/v3/users/de5e977886a64ba5a2b55a37165a8d26 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:23.961283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:23.961627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:23.962021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:23.966620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:23.968017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:23.983081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:23.984300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.038715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 980/1943] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:24.043761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.053849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 964/1944] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:24.065292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90953f-ff55-4013-a8e0-649a0b8f7837 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.070625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.072010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.072301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.072580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.073341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:24.073650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.075634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.089132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 981/1945] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:24.093558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.104910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12914-9e59-4e72-9595-3f8e9a5da179 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.106328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.108356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.111110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.111956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.113374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.113814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.116244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.120478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.162355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 965/1946] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:24 2021] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:24.163787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.247794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d59e-337a-4c64-bbe9-7f6502857b5f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.253065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.253745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.254029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.254308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.255182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.258021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.275710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15c51-ca3a-4319-b028-8a25c95d7437 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.288385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 966/1947] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:24 2021] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:24.290897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.306173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cc5d6-7745-4dc8-9b53-e9571607e286 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.316291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.316982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.317318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.317688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.318949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.321234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.333991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 967/1948] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:24.338924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.343053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.344008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.344440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.344861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.352101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf7df-61e1-428b-8834-0d5413c3bcac admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.355945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.357932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ba42-7b17-43d9-9b78-f185cfdea731 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.358613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.359364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.360095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.360095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.361414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.363381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.378067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 968/1949] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:24.378811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 982/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:24.382416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.396669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538ca4-36db-4be6-be37-2b05e4c1b346 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.404229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.405218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.405572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.406602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] PATH_INFO: `/v3/projects/60bd44f0f5434511b6d76212df95c890/users/580013e69aaa431796f4ab89408559af/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.447107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bd44f0f5434511b6d76212df95c890, user_id=580013e69aaa431796f4ab89408559af, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.452447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.478060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 969/1951] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:24 2021] PUT /identity/v3/projects/60bd44f0f5434511b6d76212df95c890/users/580013e69aaa431796f4ab89408559af/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:24.489001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.489451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.490304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.541637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] MFA Rules not processed for user `580013e69aaa431796f4ab89408559af`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:24.543177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.755005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 983/1952] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:24 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:24.764426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.766239 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.766567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.767702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.932923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4985-6a81-43d7-898d-2b0383bcee05 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.934503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4df81-d5c7-4bc4-bad7-b5ffea730c92 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:24.938696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.939674 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.939957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.940282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] PATH_INFO: `/v3/projects/baadf91abe234aac8ab4fdd264dfb973` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.941941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=baadf91abe234aac8ab4fdd264dfb973)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.944021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.944419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:24.945285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:24.945832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:24.946468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:24.965817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:24.967037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:24.978208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 984/1953] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:24 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:24.979086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:24.980738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:24.996101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775c55e-155c-4451-a3af-b6cad12a1aa0 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:25.019992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baadf91abe234aac8ab4fdd264dfb973', 'request_id': 'req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.032481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baadf91abe234aac8ab4fdd264dfb973', 'request_id': 'req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.041956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baadf91abe234aac8ab4fdd264dfb973', 'request_id': 'req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.057732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] The token cache is being invalidate because project baadf91abe234aac8ab4fdd264dfb973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:25.058271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.060033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.062067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 970/1954] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:24 2021] DELETE /identity/v3/projects/baadf91abe234aac8ab4fdd264dfb973 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:25.066081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:25.067993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:25.070965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:25.072227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:25.072648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:25.073029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] PATH_INFO: `/v3/projects/f5db9652da154b578a9caa79b0e543b4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:25.074575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5db9652da154b578a9caa79b0e543b4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:25.076970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:25.084146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325a0b7-5769-4b03-8f7f-97f3ed57b0ee admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:25.090393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:25.091539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:25.092054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:25.092478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] PATH_INFO: `/v3/users/014426407830442bb2e9190996dbcbf2` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:25.094015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014426407830442bb2e9190996dbcbf2)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:25.096329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:25.134490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5db9652da154b578a9caa79b0e543b4', 'request_id': 'req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.141105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5db9652da154b578a9caa79b0e543b4', 'request_id': 'req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.151604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5db9652da154b578a9caa79b0e543b4', 'request_id': 'req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.156263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014426407830442bb2e9190996dbcbf2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.169838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014426407830442bb2e9190996dbcbf2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.172054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] The token cache is being invalidate because project f5db9652da154b578a9caa79b0e543b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:25.172524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.173467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.175754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 985/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:24 2021] DELETE /identity/v3/projects/f5db9652da154b578a9caa79b0e543b4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:25.179464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:25.181145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014426407830442bb2e9190996dbcbf2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.181656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:25.182169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014426407830442bb2e9190996dbcbf2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.183702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014426407830442bb2e9190996dbcbf2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.200984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 971/1956] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:25 2021] DELETE /identity/v3/users/014426407830442bb2e9190996dbcbf2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:25.275835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5ceff-cb6e-4744-9a72-4b4f56cf242a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:25.368137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:25.369158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:25.371503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:25.371866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] PATH_INFO: `/v3/users/3816221665574db3917254a60258a9c0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:25.373477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3816221665574db3917254a60258a9c0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:25.380616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:25.454666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3816221665574db3917254a60258a9c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.476583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3816221665574db3917254a60258a9c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.490375 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3816221665574db3917254a60258a9c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.514853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3816221665574db3917254a60258a9c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.515938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3816221665574db3917254a60258a9c0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.532874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 986/1957] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:25 2021] DELETE /identity/v3/users/3816221665574db3917254a60258a9c0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:25.606154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:25.609576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:25.630261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df99b-9484-4d9c-8577-f494570b7281 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:25.719760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:25.720621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:25.720986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:25.721164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] PATH_INFO: `/v3/projects/ace9e34006de4a9cb8f862387a54cb0b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:25.722455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace9e34006de4a9cb8f862387a54cb0b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:25.724510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:25.806791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace9e34006de4a9cb8f862387a54cb0b', 'request_id': 'req-ca227037-9e4f-4f35-bc81-46b24bb55024'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.820875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace9e34006de4a9cb8f862387a54cb0b', 'request_id': 'req-ca227037-9e4f-4f35-bc81-46b24bb55024'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.837744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace9e34006de4a9cb8f862387a54cb0b', 'request_id': 'req-ca227037-9e4f-4f35-bc81-46b24bb55024'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.866891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] The token cache is being invalidate because project ace9e34006de4a9cb8f862387a54cb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:25.867695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.869187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:25.873769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 972/1958] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:25 2021] DELETE /identity/v3/projects/ace9e34006de4a9cb8f862387a54cb0b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:25.876661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:25.880884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:25.905921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac80c9-1e37-4e50-8014-6a94078456fe admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:25.973045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:25.979641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.039231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.040639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.040923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.041196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] PATH_INFO: `/v3/users/ff73d4d827a744e19f0fa9f968f6c7e7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.042841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff73d4d827a744e19f0fa9f968f6c7e7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.044774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.102449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227037-9e4f-4f35-bc81-46b24bb55024 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.108291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.109297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.109687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.109864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] PATH_INFO: `/v3/users/e67a8531f3a340928f0f9260558a6106` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.111112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67a8531f3a340928f0f9260558a6106)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.113088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.114405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff73d4d827a744e19f0fa9f968f6c7e7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.122884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff73d4d827a744e19f0fa9f968f6c7e7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.130673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff73d4d827a744e19f0fa9f968f6c7e7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.147251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff73d4d827a744e19f0fa9f968f6c7e7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.147976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff73d4d827a744e19f0fa9f968f6c7e7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.154635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 987/1959] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:25 2021] DELETE /identity/v3/users/ff73d4d827a744e19f0fa9f968f6c7e7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:26.157878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.157878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.168872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67a8531f3a340928f0f9260558a6106'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.182864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67a8531f3a340928f0f9260558a6106'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.192255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67a8531f3a340928f0f9260558a6106'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.193415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67a8531f3a340928f0f9260558a6106'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.194265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-6113252d-eaac-41c3-ae15-ce7b7ae39d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67a8531f3a340928f0f9260558a6106'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.216173 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 973/1960] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:25 2021] DELETE /identity/v3/users/e67a8531f3a340928f0f9260558a6106 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:26.220850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35258-8849-441e-b428-e94abfbab7af None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.221539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35258-8849-441e-b428-e94abfbab7af None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.222042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35258-8849-441e-b428-e94abfbab7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.229421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cd1ab-a354-4a79-a374-4e9000f87684 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.250019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-17f35258-8849-441e-b428-e94abfbab7af None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:26.253100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-17f35258-8849-441e-b428-e94abfbab7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.295627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.297534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.297534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.297534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] PATH_INFO: `/v3/projects/3e1b28f6bbfd47788954d00917d04446` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.298637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1b28f6bbfd47788954d00917d04446)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.300721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.342887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 974/1961] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:26.353105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1b28f6bbfd47788954d00917d04446', 'request_id': 'req-48c04660-2dfc-4c2a-9199-70ccf854e520'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.358359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1b28f6bbfd47788954d00917d04446', 'request_id': 'req-48c04660-2dfc-4c2a-9199-70ccf854e520'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.361219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35258-8849-441e-b428-e94abfbab7af None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.363106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-17f35258-8849-441e-b428-e94abfbab7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.369666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1b28f6bbfd47788954d00917d04446', 'request_id': 'req-48c04660-2dfc-4c2a-9199-70ccf854e520'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.383106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] The token cache is being invalidate because project 3e1b28f6bbfd47788954d00917d04446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:26.383619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.384407 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-48c04660-2dfc-4c2a-9199-70ccf854e520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.386471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 988/1962] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:26 2021] DELETE /identity/v3/projects/3e1b28f6bbfd47788954d00917d04446 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:26.391792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5c51-0d23-4204-87a5-98692e2f59ec None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.392077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5c51-0d23-4204-87a5-98692e2f59ec None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.392526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5c51-0d23-4204-87a5-98692e2f59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.419376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c81e5c51-0d23-4204-87a5-98692e2f59ec None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:26.420337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c81e5c51-0d23-4204-87a5-98692e2f59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.432320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35258-8849-441e-b428-e94abfbab7af None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.516481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 989/1963] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:26.516678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.517568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.518615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.518615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.519839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.520392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.520870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.521356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.552905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.557953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.570427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:26.573943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.584939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 975/1964] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:26.587198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 990/1965] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:26.587546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.589894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.601020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37fe69-a8f4-4f0f-a130-8504aea599f8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.602333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.608290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.609058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.609486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.609812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.610674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:26.611432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.613120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.632056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 991/1966] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:26.633930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.636855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7897-fd53-42c2-a0be-7301766ba9a1 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.643662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b797a1-9afd-4c10-aac8-d57a626c1687 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.648618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.649376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.649663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.649938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.650675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.652679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.652825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.653554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.653840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.654281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] PATH_INFO: `/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.657964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd94b8cf19f143a9b8a3448af5a168c8)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.662753 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.760572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd94b8cf19f143a9b8a3448af5a168c8', 'request_id': 'req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.769435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd94b8cf19f143a9b8a3448af5a168c8', 'request_id': 'req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.776983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd94b8cf19f143a9b8a3448af5a168c8', 'request_id': 'req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.812875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] The token cache is being invalidate because project bd94b8cf19f143a9b8a3448af5a168c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:26.813817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.813932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9c6cc836-4ed3-4c14-8bc0-190e62ffef2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:26.816111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 976/1967] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:26 2021] DELETE /identity/v3/projects/bd94b8cf19f143a9b8a3448af5a168c8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:26.819405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 992/1968] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:26.824616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.826145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136fcd-6cf9-424c-b51d-687a4d885da5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.826436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136fcd-6cf9-424c-b51d-687a4d885da5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.826769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136fcd-6cf9-424c-b51d-687a4d885da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.826961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.850396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8d136fcd-6cf9-424c-b51d-687a4d885da5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:26.852925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8d136fcd-6cf9-424c-b51d-687a4d885da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.906010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4783-b960-411b-9819-c5e2bdb3f144 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.912472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.913853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.913853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.920406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.921390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:26.923653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:26.938676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 977/1969] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:26.948988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.949370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.949738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.950498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 993/1970] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:26.955610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:26.978241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdb9f2-3880-4513-99fc-a430833ed751 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:26.982324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:26.983997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:26.994752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:26.995953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:26.996294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:26.996515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:26.997440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.001879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.005757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 978/1971] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:27.010212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.021003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed712d6a-fad6-4334-97e4-d05ea94fb145 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.026320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 994/1972] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:26 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:27.029581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.029581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.029581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.029832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.030594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.030995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:27.031518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.033433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.048724 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaad7c-0b19-471f-ade9-79e9e5fb35ba admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.054104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 979/1973] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:27.055195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.060778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.061454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.061733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.062006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.062769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.064353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.069418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264c377-5146-4590-a1d4-8e920eaf1a3a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.075107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.075936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.076222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.076560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.077412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.080170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.085557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 995/1974] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:27 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:27.090910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.114459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc25b88-3488-4b81-bf3e-dd0e605959e9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.127190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.128180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.128464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.128735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] PATH_INFO: `/v3/projects/3cfbbb4dabf04c478bf0c8012556a286/users/953a4a7b4c494b4b918c002a25dceba0/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.131687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 980/1975] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:27.136461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.167492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfbbb4dabf04c478bf0c8012556a286, user_id=953a4a7b4c494b4b918c002a25dceba0, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.170155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779831d-9c91-46ec-b236-d21329dee619 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.207450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 996/1976] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:27 2021] PUT /identity/v3/projects/3cfbbb4dabf04c478bf0c8012556a286/users/953a4a7b4c494b4b918c002a25dceba0/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:27.220903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.221303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.222288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.263183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] MFA Rules not processed for user `953a4a7b4c494b4b918c002a25dceba0`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:27.264868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:27.267837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d540959-ca32-44b1-9475-13acf4244ef1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.434406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 997/1977] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:27.439923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.471268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.475637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.479195 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.479697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.480650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.483646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.535542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 981/1978] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/users => generated 292 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:27.541581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.552027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e607-330c-4fc1-b7d0-f003502a62a4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.555976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be053-a4d6-4eed-a6fe-0d696cceab8a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.559401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.560519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.560899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.561232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.562439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.564132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.564780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.564895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.565077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.565399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.566159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.568606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.584645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 982/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:27 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:27.589101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.602356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 998/1980] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:27.605881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.611593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0fe11-f299-405e-9142-70f1ac8e8b73 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.703394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.704280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.704665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.705043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.706065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.707804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.720284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 983/1981] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:27 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:27.727395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.734271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7dc2-4b0d-4a2a-b33f-d357133dc2a8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.738177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c744e-ab3f-41d5-bb78-8fab1deb664d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.739403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.740175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.740557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.740931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.741746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.743928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.746332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.747257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.747542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.748415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] PATH_INFO: `/v3/projects/1584f223cd994a87ac98d3ae4ef89de7/users/459eaae96760403391c9f1529b41fe98/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.770974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1584f223cd994a87ac98d3ae4ef89de7, user_id=459eaae96760403391c9f1529b41fe98, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.774351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.782098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 999/1982] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:27.783293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.788140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:27.818659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 984/1983] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:27 2021] PUT /identity/v3/projects/1584f223cd994a87ac98d3ae4ef89de7/users/459eaae96760403391c9f1529b41fe98/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:27.820452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:27.837197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5322b7-363d-4eaa-ace3-3c6908cb04aa admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.897274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ab0b-31d2-4c6c-960e-7bad0fff4308 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:27.904776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.905544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.905765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.906043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.906816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.907690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:27.909076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cfc91-29b3-46e7-a680-17308cfdcec6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.909199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.909199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.909359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] PATH_INFO: `/v3/projects/a9e1ff586d4c47b0b281fdc5799b185a` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.911064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e1ff586d4c47b0b281fdc5799b185a)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:27.913109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:27.922383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 985/1984] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:27 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:27.922383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:27.922383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:27.922383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:27.964980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e1ff586d4c47b0b281fdc5799b185a', 'request_id': 'req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:27.968047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] MFA Rules not processed for user `459eaae96760403391c9f1529b41fe98`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:27.969293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:27.976783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e1ff586d4c47b0b281fdc5799b185a', 'request_id': 'req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:27.986464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e1ff586d4c47b0b281fdc5799b185a', 'request_id': 'req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.009865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] The token cache is being invalidate because project a9e1ff586d4c47b0b281fdc5799b185a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:28.010301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.011137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.012964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1000/1985] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:27 2021] DELETE /identity/v3/projects/a9e1ff586d4c47b0b281fdc5799b185a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.023175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.024910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.086964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 986/1986] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:27 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:28.088163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.089687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.178778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a8471-ccdb-472c-81f5-c641edd9edb9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.185460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.186739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.187280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.187771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] PATH_INFO: `/v3/projects/ae8eefe185804736be4841e36d7a8022/users/43ff58ff3ac1465c8b2abcf9135e97aa/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.191672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8fdb-4f45-448c-95d8-cd93ab6e110e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.201037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.202529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.203494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.203968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] PATH_INFO: `/v3/users/580013e69aaa431796f4ab89408559af` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.205467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8eefe185804736be4841e36d7a8022, user_id=43ff58ff3ac1465c8b2abcf9135e97aa, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.206271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580013e69aaa431796f4ab89408559af)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.209191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.209957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.228791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 987/1987] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:28 2021] PUT /identity/v3/projects/ae8eefe185804736be4841e36d7a8022/users/43ff58ff3ac1465c8b2abcf9135e97aa/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.230586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.233348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.283097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580013e69aaa431796f4ab89408559af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.297857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580013e69aaa431796f4ab89408559af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.309210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580013e69aaa431796f4ab89408559af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.325436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580013e69aaa431796f4ab89408559af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.326322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580013e69aaa431796f4ab89408559af'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.333531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1001/1988] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:28 2021] DELETE /identity/v3/users/580013e69aaa431796f4ab89408559af => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.337521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.339429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.381625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ccf85-9e9b-4042-a9d4-41ebffbd076a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.448905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb2d6-e4db-416b-a01f-6a03c39582e3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.453751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.454651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.454940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.455598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.457473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.468350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.470064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.470354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.470668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] PATH_INFO: `/v3/users/ae490813a2ac4681acc0daaf95d30d8f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.472102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae490813a2ac4681acc0daaf95d30d8f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.475938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.570601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae490813a2ac4681acc0daaf95d30d8f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.577907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.579423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.588289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae490813a2ac4681acc0daaf95d30d8f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.590535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1002/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:28 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:28.591409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.592763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.611148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653e2f-90b3-4012-841c-e39458358676 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.612865 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae490813a2ac4681acc0daaf95d30d8f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.613670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae490813a2ac4681acc0daaf95d30d8f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.614840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2cfa454-3976-4050-a918-8d3b3b063320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae490813a2ac4681acc0daaf95d30d8f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.628053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.628854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.629161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.629500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.630281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.633980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.642038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 988/1990] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:28 2021] DELETE /identity/v3/users/ae490813a2ac4681acc0daaf95d30d8f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.643578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.643863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.644140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.666134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1003/1991] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:28 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:28.668633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.670796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.688109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442f90-5c27-4bac-b5d6-cbf66fe142a8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.719183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:28.720520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.766136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.767283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.767793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.768111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] PATH_INFO: `/v3/users/459eaae96760403391c9f1529b41fe98` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.770399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459eaae96760403391c9f1529b41fe98)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.772754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.884225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 989/1992] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:28.885981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.887758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.906396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9ea5-6ec4-4b05-99f3-80d891aa0fae None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:28.914455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:28.915544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.915923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.916206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] PATH_INFO: `/v3/projects/ae8eefe185804736be4841e36d7a8022/users/43ff58ff3ac1465c8b2abcf9135e97aa/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:28.919519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8eefe185804736be4841e36d7a8022, user_id=43ff58ff3ac1465c8b2abcf9135e97aa, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:28.921129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459eaae96760403391c9f1529b41fe98'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.922728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:28.933005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459eaae96760403391c9f1529b41fe98'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.946821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 990/1993] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:28 2021] PUT /identity/v3/projects/ae8eefe185804736be4841e36d7a8022/users/43ff58ff3ac1465c8b2abcf9135e97aa/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.946821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:28.946821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:28.954699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459eaae96760403391c9f1529b41fe98'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.971090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459eaae96760403391c9f1529b41fe98'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.972108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-af839bff-0c82-41fe-bf6a-0372f8f8da42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459eaae96760403391c9f1529b41fe98'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:28.981148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1004/1994] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:28 2021] DELETE /identity/v3/users/459eaae96760403391c9f1529b41fe98 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:28.982587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee21ea-59fe-4c1a-bb3d-ab139f383685 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:28.983010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee21ea-59fe-4c1a-bb3d-ab139f383685 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:28.983388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee21ea-59fe-4c1a-bb3d-ab139f383685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.063977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1fee21ea-59fe-4c1a-bb3d-ab139f383685 None None] MFA Rules not processed for user `43ff58ff3ac1465c8b2abcf9135e97aa`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:29.065943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1fee21ea-59fe-4c1a-bb3d-ab139f383685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.080524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516e332-6162-41f9-a852-b7828732fe28 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.148668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.149331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.149610 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.149884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.153668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.174870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1005/1995] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:28 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:29.176340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.177005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.177005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.208888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:29.212003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.295115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1006/1996] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:29.295115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.295115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.297670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.299364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.320696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 991/1997] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:29.321948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.324405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.340281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29a50-e632-463c-9264-87b9ac4f1163 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.349252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.350472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.350944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.351228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] PATH_INFO: `/v3/projects/56514e24612749e2ac5a700df1221f83` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.353331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56514e24612749e2ac5a700df1221f83)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.355198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.391863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc358d6-2376-45a4-96a2-0f255a49d8a9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.396036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.396791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.397075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.397353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.411582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.413349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.424341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1007/1998] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:29 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:29.425255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.426744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.434429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56514e24612749e2ac5a700df1221f83', 'request_id': 'req-a4515f71-0467-423e-9b76-5c3cf323e1fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.441051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56514e24612749e2ac5a700df1221f83', 'request_id': 'req-a4515f71-0467-423e-9b76-5c3cf323e1fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.448135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56514e24612749e2ac5a700df1221f83', 'request_id': 'req-a4515f71-0467-423e-9b76-5c3cf323e1fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.451642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b2f8-8704-4ecc-a449-8e82468d38c5 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.464074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] The token cache is being invalidate because project 56514e24612749e2ac5a700df1221f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:29.464371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.465427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-a4515f71-0467-423e-9b76-5c3cf323e1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.467619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 992/1999] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:29 2021] DELETE /identity/v3/projects/56514e24612749e2ac5a700df1221f83 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:29.474566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3426e-17cc-4066-b73a-6b85cf16cd48 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.474944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3426e-17cc-4066-b73a-6b85cf16cd48 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.475400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3426e-17cc-4066-b73a-6b85cf16cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.505024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d4d3426e-17cc-4066-b73a-6b85cf16cd48 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:29.507895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d4d3426e-17cc-4066-b73a-6b85cf16cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.526380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.527559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.527847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.528156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.530100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.624243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.626397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.636443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 993/2000] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:29.638187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.638520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.639016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.652913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1008/2001] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:29.691803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:29.695595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.715792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 994/2002] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:29.717986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.729764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67625f5d-033f-486f-9f93-dbd48d4c0faa service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.735283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.736045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.736325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.736594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.737433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:29.737735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.739919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.757604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1009/2003] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:47:29.759219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.760847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:29.770880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.781148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1603-9f9e-4b12-85cf-b2e0e32b0060 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.797917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a994be-00ef-46c4-b97c-e75230ad8184 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:29.806280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.807159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.807516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.808119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.809091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.811721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:29.812764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:29.812951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:29.813255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] PATH_INFO: `/v3/projects/60bd44f0f5434511b6d76212df95c890` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:29.814699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bd44f0f5434511b6d76212df95c890)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:29.816599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.822126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:29.870712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1010/2004] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:29 2021] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:29.872409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:29.907262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bd44f0f5434511b6d76212df95c890', 'request_id': 'req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.925308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bd44f0f5434511b6d76212df95c890', 'request_id': 'req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.932393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bd44f0f5434511b6d76212df95c890', 'request_id': 'req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.954185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] The token cache is being invalidate because project 60bd44f0f5434511b6d76212df95c890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:29.954479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.955234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:29.959254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 995/2005] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:29 2021] DELETE /identity/v3/projects/60bd44f0f5434511b6d76212df95c890 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:29.981964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af036fe-e508-472d-b218-0e1e2e1521fa admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.146371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.147500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.148142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.149133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.150465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.152961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.186648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1011/2006] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:29 2021] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:30.189023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.191074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.194042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.196748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.218799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72b6d-89c8-4504-a8d4-3f55bae522c2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.229488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc481b-9316-46ea-979e-bc2cb91614f3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.234690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.235138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.235813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.236097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.236378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.237131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.237288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.237941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.238430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] PATH_INFO: `/v3/projects/1584f223cd994a87ac98d3ae4ef89de7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.238765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.245650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1584f223cd994a87ac98d3ae4ef89de7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.245650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.252857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 996/2007] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:30.256346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.270275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70640f-5878-4e33-b8d2-1f27473a91e4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.276383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.277689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.278141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.279234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.280341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.282298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.293949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 997/2008] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:30.299852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.311379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba88-4abf-4d78-897c-ca8403099255 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.312581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1584f223cd994a87ac98d3ae4ef89de7', 'request_id': 'req-bdc0b624-63e2-4a30-8647-42c6ff9aad35'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.320134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1584f223cd994a87ac98d3ae4ef89de7', 'request_id': 'req-bdc0b624-63e2-4a30-8647-42c6ff9aad35'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.328167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1584f223cd994a87ac98d3ae4ef89de7', 'request_id': 'req-bdc0b624-63e2-4a30-8647-42c6ff9aad35'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.339690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] The token cache is being invalidate because project 1584f223cd994a87ac98d3ae4ef89de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:30.340008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.340703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.342237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1012/2009] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:30 2021] DELETE /identity/v3/projects/1584f223cd994a87ac98d3ae4ef89de7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:30.347293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.348586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.368598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.370155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.370808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.371095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] PATH_INFO: `/v3/projects/d16fcbfeebaa4a448c0e46e65554fe13/users/dd314f61ea104e49ac86c97a9199af69/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.387653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16fcbfeebaa4a448c0e46e65554fe13, user_id=dd314f61ea104e49ac86c97a9199af69, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.390447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a46fa-b348-4817-8b99-7a2c25f432be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.404736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 998/2010] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:30 2021] PUT /identity/v3/projects/d16fcbfeebaa4a448c0e46e65554fe13/users/dd314f61ea104e49ac86c97a9199af69/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:30.406066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca5ebc-65f7-46b4-ab18-3a6bc488091a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.406359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca5ebc-65f7-46b4-ab18-3a6bc488091a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.406682 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca5ebc-65f7-46b4-ab18-3a6bc488091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.413851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0b624-63e2-4a30-8647-42c6ff9aad35 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.432822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e8ca5ebc-65f7-46b4-ab18-3a6bc488091a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:30.434034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e8ca5ebc-65f7-46b4-ab18-3a6bc488091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.500920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.502215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.502517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.502812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] PATH_INFO: `/v3/users/953a4a7b4c494b4b918c002a25dceba0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.504228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953a4a7b4c494b4b918c002a25dceba0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.507235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.515937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 999/2011] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:30.517437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524672fb-0b91-4436-85f2-03817893207c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.517704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524672fb-0b91-4436-85f2-03817893207c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.517985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524672fb-0b91-4436-85f2-03817893207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.545268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-524672fb-0b91-4436-85f2-03817893207c None None] MFA Rules not processed for user `dd314f61ea104e49ac86c97a9199af69`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:30.546445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-524672fb-0b91-4436-85f2-03817893207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.560400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953a4a7b4c494b4b918c002a25dceba0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.567954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953a4a7b4c494b4b918c002a25dceba0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.575238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953a4a7b4c494b4b918c002a25dceba0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.587093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953a4a7b4c494b4b918c002a25dceba0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.587715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-37ece5b6-96ad-43f9-9659-3ccc54ec6152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953a4a7b4c494b4b918c002a25dceba0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:30.593538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1013/2012] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:30 2021] DELETE /identity/v3/users/953a4a7b4c494b4b918c002a25dceba0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:30.594727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.595018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.595295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.612586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:30.613126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1000/2013] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:30.614424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.614756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.614915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.615023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.631744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:30.633457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.673129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1014/2014] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:30.673948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.675229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.686404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d108-0feb-4b1c-9c64-52389ba6b81b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.689245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1001/2015] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:30.690149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.691007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.691656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.691941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.692223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.693293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.694900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.700220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351b61-2903-423e-bc77-95d7986a8730 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.704950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.705597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.705874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.706151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.706916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:30.707226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.708800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.721115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1002/2016] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:30.721357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1015/2017] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:30.722236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.724042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:30.725194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.735764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9b06b-f55a-43bf-820d-45943de193a1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.784709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07836-b1b8-4554-92c5-7772ffec241f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.788397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.789201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.789462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.789594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.789846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.790377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.790837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.791112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.791852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.793809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.798733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.800262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.814758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1016/2018] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:30.815447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1003/2019] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:30.816615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.819430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.827039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f0d0-acb4-4186-a633-1b4435eab746 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.831765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.831954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add55db3-6b90-4e5d-88b9-44cee8bda7c5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.832414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.832694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.832970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.833977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.835723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.837823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.838491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.839404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.839952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.840693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.842535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.853584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1004/2020] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:30.857907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.865386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1017/2021] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:30.870191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.872193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9d2d1-d933-45c1-a8c4-62350c94228c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.937644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52b93c-1626-4fa3-a1cf-55f96278bfd2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.942688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.943357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.943636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.943912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.944622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.947099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.950381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:30.951278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:30.951748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:30.952126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:30.952967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:30.954789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:30.968583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1005/2022] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:30.971571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.983192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1018/2023] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:30 2021] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:30.986862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:30.994527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9eea-8325-4289-8f5a-37e3cd5db45d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:30.998217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35965-47a3-400f-beee-e9bdb38679a4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.000183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.001434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.001713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.001985 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] PATH_INFO: `/v3/projects/b5b5eb5ee957406ba322dee25ed95947/users/15b19df9f808416db79227b2e8ae1605/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.003698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.004432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.004791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.005137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.006107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.007891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.018262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b5eb5ee957406ba322dee25ed95947, user_id=15b19df9f808416db79227b2e8ae1605, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.021000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493bb6e-3010-4c57-b8b1-9461e1b2ece4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.025613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1019/2024] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:31.027124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.037266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1006/2025] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:30 2021] PUT /identity/v3/projects/b5b5eb5ee957406ba322dee25ed95947/users/15b19df9f808416db79227b2e8ae1605/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.038876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545bd96-c2cc-4304-95b0-1e62d7c8c189 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.048659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.048970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.049367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.076116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] MFA Rules not processed for user `15b19df9f808416db79227b2e8ae1605`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:31.077542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.106776 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.107328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.107611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.107885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.108628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.110218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.125637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1020/2026] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:31 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:31.125637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.127870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.143183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a557a-0861-44b7-9ed6-69ba66e377bc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.150181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.150525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.150845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.151126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] PATH_INFO: `/v3/projects/3cfbbb4dabf04c478bf0c8012556a286` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.152338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfbbb4dabf04c478bf0c8012556a286)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.154326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.158600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1007/2027] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:31.158600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.169113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300aead-6030-4d1c-a9b5-bd3181d99545 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.174754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.175745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.176019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.176288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] PATH_INFO: `/v3/projects/15bba1ec64de4d0da5d6bab1ba396fe8/users/898c4666dff04eee89ce2bde0a74a1a4/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.192181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bba1ec64de4d0da5d6bab1ba396fe8, user_id=898c4666dff04eee89ce2bde0a74a1a4, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.194846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.206184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfbbb4dabf04c478bf0c8012556a286', 'request_id': 'req-cc002a36-86ba-47b3-8b02-c12822b7c966'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.207961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1008/2028] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:31 2021] PUT /identity/v3/projects/15bba1ec64de4d0da5d6bab1ba396fe8/users/898c4666dff04eee89ce2bde0a74a1a4/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.208667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.217528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfbbb4dabf04c478bf0c8012556a286', 'request_id': 'req-cc002a36-86ba-47b3-8b02-c12822b7c966'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.225435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfbbb4dabf04c478bf0c8012556a286', 'request_id': 'req-cc002a36-86ba-47b3-8b02-c12822b7c966'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.237191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] The token cache is being invalidate because project 3cfbbb4dabf04c478bf0c8012556a286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:31.237496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.238158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cc002a36-86ba-47b3-8b02-c12822b7c966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.239725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1021/2029] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:31 2021] DELETE /identity/v3/projects/3cfbbb4dabf04c478bf0c8012556a286 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.242802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.242802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.242802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.267132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] MFA Rules not processed for user `898c4666dff04eee89ce2bde0a74a1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:31.268530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.269448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2469-0ef2-480a-9a88-6436c051cca4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.274926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.275570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.275845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.276130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.276810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.278734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.303038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1009/2030] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:31.304391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.306971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.337706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1022/2031] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:31.339578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.341002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.355405 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82dd5-dda1-4989-a170-2f39476592c6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.382134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c3ec-06da-46ff-8983-f65bf6252ba2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.387522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.388595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.389045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.389320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] PATH_INFO: `/v3/users/43ff58ff3ac1465c8b2abcf9135e97aa` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.390568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ff58ff3ac1465c8b2abcf9135e97aa)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.392519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.413609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.414934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.415289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.415644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.416418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.419008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.446133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1023/2032] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:31.446133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.446512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.447193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ff58ff3ac1465c8b2abcf9135e97aa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.459586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ff58ff3ac1465c8b2abcf9135e97aa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.466045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ff58ff3ac1465c8b2abcf9135e97aa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.466786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ff58ff3ac1465c8b2abcf9135e97aa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.467407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ff58ff3ac1465c8b2abcf9135e97aa'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.480838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1010/2033] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:31 2021] DELETE /identity/v3/users/43ff58ff3ac1465c8b2abcf9135e97aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.481780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.483223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.513313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fa24e-be63-4ad2-b4ec-90fbb42639f7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.565337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28c666-4cc6-44fa-af56-57cc288928c5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.570996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.571671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.571952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.572226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.572954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.573087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.574967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.575168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.575636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.576250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.579906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.590353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1011/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:31 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:31.591287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.604573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b6838-0b17-4d7e-9221-84235d8e0593 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.610276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.611202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.611479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.611750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] PATH_INFO: `/v3/projects/2af4106dca27443cb4c5e263c5d15898/users/6182725630e547299725d738a86e5c1a/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.628394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af4106dca27443cb4c5e263c5d15898, user_id=6182725630e547299725d738a86e5c1a, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.632090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.646941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1012/2035] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:31 2021] PUT /identity/v3/projects/2af4106dca27443cb4c5e263c5d15898/users/6182725630e547299725d738a86e5c1a/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.651426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.652505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.654098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.667607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1024/2036] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:31.716382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd326-0a65-4cf5-939c-5c1f20ecbb73 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.724273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.724947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.725287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.725589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.726316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.728727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.739422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1013/2037] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:31 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:31.743505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.754408 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e1f5-9c01-46ac-944c-3fb4c8bb4e27 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.761692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.762624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.762909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.763191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] PATH_INFO: `/v3/projects/2af4106dca27443cb4c5e263c5d15898/users/6182725630e547299725d738a86e5c1a/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.765404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af4106dca27443cb4c5e263c5d15898, user_id=6182725630e547299725d738a86e5c1a, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.768460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d9d9-ed8e-40ee-9b46-d365e890739a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.780622 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1025/2038] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:31 2021] PUT /identity/v3/projects/2af4106dca27443cb4c5e263c5d15898/users/6182725630e547299725d738a86e5c1a/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:47:31.784037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.785945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.791234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.791648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.791774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.801472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775b230-51b1-44c9-bd1f-153f37e731dd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:31.829662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] MFA Rules not processed for user `6182725630e547299725d738a86e5c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:31.831016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.868047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:31.868896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.869177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.869448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] PATH_INFO: `/v3/projects/ae8eefe185804736be4841e36d7a8022` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:31.870692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8eefe185804736be4841e36d7a8022)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:31.872759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:31.904631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1026/2039] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:31.919087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:31.920892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:31.933972 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8eefe185804736be4841e36d7a8022', 'request_id': 'req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.939603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8eefe185804736be4841e36d7a8022', 'request_id': 'req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.946839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8eefe185804736be4841e36d7a8022', 'request_id': 'req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.980471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] The token cache is being invalidate because project ae8eefe185804736be4841e36d7a8022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:31.980471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.980471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4d9461a-af33-4d96-ac61-3e4a6d3dd78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:31.982452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1014/2040] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:31 2021] DELETE /identity/v3/projects/ae8eefe185804736be4841e36d7a8022 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:31.984055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76b9c-4a81-4058-9283-fde551150a22 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:31.984345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76b9c-4a81-4058-9283-fde551150a22 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:31.984622 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76b9c-4a81-4058-9283-fde551150a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.001350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2edc8-d115-47cb-b507-ced1f424603b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.011312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fca76b9c-4a81-4058-9283-fde551150a22 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:32.012708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fca76b9c-4a81-4058-9283-fde551150a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:32.054142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.055590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.055937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.056280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.058130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:32.079585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1015/2041] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:32.088050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.088341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.088641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.106917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:32.108110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:32.115847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1016/2042] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:32.120663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.129543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1ac52-084e-4b71-8ae5-cf5ef0819746 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.133537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.134417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.135098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.135236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.135378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.135652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.136385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:32.136684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.138357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.144924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1027/2043] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:32.149957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1017/2044] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:47:32.154967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.165399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec947c4c-d92f-418b-b289-8482a92c307c service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.169921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.170580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.170928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.171202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.171892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.173753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.202157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1028/2045] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:32 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:32.206264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.222005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65261041-8813-4287-8478-a0f8e6e299c7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.302751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.303435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.303754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.304063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.304816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.307163 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.326520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1018/2046] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:32 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:32.330814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.341778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9f0-ae7a-439e-8b75-5bb177c6d343 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.347352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.348151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.348570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.348873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.349614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.351413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.362482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1029/2047] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:47:32.366695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.376801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9fcf-6ada-4f73-92eb-b44fb69ee31a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.381898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.392676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.392676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.392676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.392676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.392676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8722-635d-4a69-a1de-8789dd4b19e6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.396441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1019/2048] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:32.401041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.410805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dd4d6-0ba2-4a60-8891-130463d1f46d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.416175 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.417055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.417330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.417598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] PATH_INFO: `/v3/projects/9ca133e69a124f128c2a0765f400fae7/users/fa03f284337a415abef8eb9fcd59abde/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.440333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca133e69a124f128c2a0765f400fae7, user_id=fa03f284337a415abef8eb9fcd59abde, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.440333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.450635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1030/2049] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:32 2021] PUT /identity/v3/projects/9ca133e69a124f128c2a0765f400fae7/users/fa03f284337a415abef8eb9fcd59abde/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:32.462022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.462469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.463088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.491980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] MFA Rules not processed for user `fa03f284337a415abef8eb9fcd59abde`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:32.493358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:32.559417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1020/2050] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:32.570447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:32.572151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:32.628101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c83ab-35f2-437c-91e5-5ef715bf63c7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:32.631706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:32.632332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:32.632608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:32.632902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:32.640714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:32.642453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:32.652193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1031/2051] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:32 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:47:33.639078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:33.640334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:33.695509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83c73-59cd-41cc-a98f-ede913d35052 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:33.699259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:33.701722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:33.701722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:33.701722 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:33.702974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:33.761997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:33.763728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859b98a-2959-4174-88f1-b9c757d6c9d4 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:33.773504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1021/2052] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:35.857183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:35.866007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ee81-b569-4f5e-be70-3c217cd7664c service glance] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:35.870240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:35.870881 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:35.871188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:35.871459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:35.873325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:35.934785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:35.936210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:35.945424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1032/2053] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:35 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:45.780922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f341c-c8b9-459d-862b-96e891e5bfeb None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:45.781592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f341c-c8b9-459d-862b-96e891e5bfeb None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:45.781592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f341c-c8b9-459d-862b-96e891e5bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:45.801744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7e1f341c-c8b9-459d-862b-96e891e5bfeb None None] MFA Rules not processed for user `a89417ea7c7442289745cb1851eccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:45.803958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7e1f341c-c8b9-459d-862b-96e891e5bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:45.861655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1022/2054] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:48.266830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:48.268247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:48.332572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11817e4c-3fab-4f26-ab4c-0d4eeaf71e13 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:48.337860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:48.338754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:48.339035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:48.339303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] PATH_INFO: `/v3/users/dd314f61ea104e49ac86c97a9199af69` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:48.340518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd314f61ea104e49ac86c97a9199af69)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:48.342446 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:48.391491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd314f61ea104e49ac86c97a9199af69'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:48.400415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd314f61ea104e49ac86c97a9199af69'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:48.410941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd314f61ea104e49ac86c97a9199af69'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:48.425189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd314f61ea104e49ac86c97a9199af69'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:48.425961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd314f61ea104e49ac86c97a9199af69'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:48.435435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1033/2055] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:48 2021] DELETE /identity/v3/users/dd314f61ea104e49ac86c97a9199af69 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:48.440506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:48.440939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:48.440939 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:48.469445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:48.471039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:48.538305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1023/2056] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:48.553233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:48.555060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:48.614039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83281e-4c59-4ccd-99a6-c76759794072 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:48.617680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:48.618323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:48.618630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:48.618907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:48.628224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:48.629644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:48.639508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1034/2057] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:47:48.918655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:48.920104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:48.934403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67b88-2663-4310-9d23-c5077625af4b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:48.943166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:48.944161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:48.944438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:48.944707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] PATH_INFO: `/v3/projects/d16fcbfeebaa4a448c0e46e65554fe13` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:48.946538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16fcbfeebaa4a448c0e46e65554fe13)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:48.948482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:49.002540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16fcbfeebaa4a448c0e46e65554fe13', 'request_id': 'req-55ce07f8-8311-4f99-925e-7be694605569'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.010649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16fcbfeebaa4a448c0e46e65554fe13', 'request_id': 'req-55ce07f8-8311-4f99-925e-7be694605569'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.018446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16fcbfeebaa4a448c0e46e65554fe13', 'request_id': 'req-55ce07f8-8311-4f99-925e-7be694605569'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.035426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] The token cache is being invalidate because project d16fcbfeebaa4a448c0e46e65554fe13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:49.035987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.037253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.042434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1024/2058] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:48 2021] DELETE /identity/v3/projects/d16fcbfeebaa4a448c0e46e65554fe13 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:49.043584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:49.057309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9cdc9-4d25-4f46-b683-d2957be3bd97 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:49.127573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:49.128654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:49.129359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:49.129808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] PATH_INFO: `/v3/users/15b19df9f808416db79227b2e8ae1605` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:49.131340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b19df9f808416db79227b2e8ae1605)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:49.145276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:49.199703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b19df9f808416db79227b2e8ae1605'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.208351 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b19df9f808416db79227b2e8ae1605'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.217101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b19df9f808416db79227b2e8ae1605'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.233593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b19df9f808416db79227b2e8ae1605'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.234806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b19df9f808416db79227b2e8ae1605'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.245252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1035/2059] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:49 2021] DELETE /identity/v3/users/15b19df9f808416db79227b2e8ae1605 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:49.671663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:49.673142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:49.688183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce07f8-8311-4f99-925e-7be694605569 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:49.748317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:49.749183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:49.749466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:49.749743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] PATH_INFO: `/v3/projects/b5b5eb5ee957406ba322dee25ed95947` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:49.751237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b5eb5ee957406ba322dee25ed95947)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:49.753156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:49.798723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b5eb5ee957406ba322dee25ed95947', 'request_id': 'req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.804079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b5eb5ee957406ba322dee25ed95947', 'request_id': 'req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.810528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b5eb5ee957406ba322dee25ed95947', 'request_id': 'req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.824723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] The token cache is being invalidate because project b5b5eb5ee957406ba322dee25ed95947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:49.825038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.825809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.827933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1025/2060] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:49 2021] DELETE /identity/v3/projects/b5b5eb5ee957406ba322dee25ed95947 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:49.832488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:49.833941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:49.846730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30bd1-aa07-40ef-8336-d00394a59410 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:49.904961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:49.906007 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:49.906356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:49.906735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] PATH_INFO: `/v3/users/6182725630e547299725d738a86e5c1a` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:49.908024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6182725630e547299725d738a86e5c1a)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:49.910069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:49.960763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6182725630e547299725d738a86e5c1a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.967888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6182725630e547299725d738a86e5c1a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.974726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6182725630e547299725d738a86e5c1a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.987799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6182725630e547299725d738a86e5c1a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.988664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f018f764-b05e-408b-b902-fc328f4cb7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6182725630e547299725d738a86e5c1a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:49.995556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1036/2061] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:47:49 2021] DELETE /identity/v3/users/6182725630e547299725d738a86e5c1a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:50.487039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:50.488526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:50.502179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6f19-072a-49c6-8c50-9b3ef787bbac admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:50.569737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:50.570696 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.571022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.571351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] PATH_INFO: `/v3/projects/2af4106dca27443cb4c5e263c5d15898` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.572609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af4106dca27443cb4c5e263c5d15898)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:50.574635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:50.623604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af4106dca27443cb4c5e263c5d15898', 'request_id': 'req-ab32d3fd-3104-4971-aa84-79a34f8dfd54'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:50.629819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af4106dca27443cb4c5e263c5d15898', 'request_id': 'req-ab32d3fd-3104-4971-aa84-79a34f8dfd54'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:50.637626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af4106dca27443cb4c5e263c5d15898', 'request_id': 'req-ab32d3fd-3104-4971-aa84-79a34f8dfd54'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:50.650540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] The token cache is being invalidate because project 2af4106dca27443cb4c5e263c5d15898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:47:50.650862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:50.651654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ab32d3fd-3104-4971-aa84-79a34f8dfd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:47:50.653459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1026/2062] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:47:50 2021] DELETE /identity/v3/projects/2af4106dca27443cb4c5e263c5d15898 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:50.659489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.659804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.660213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.678376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:50.679675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:50.761506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1037/2063] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:50.769572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.770048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.770140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.788000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:50.789727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:50.797554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1027/2064] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:47:50.801659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:50.811543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff1e6b-104d-4a59-bd9c-360879d2f149 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:50.816373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:50.817043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.817317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.817585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.818335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:47:50.818684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:50.820300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:50.831207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1038/2065] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:47:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:47:50.835167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:50.843887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35971b-91bd-4450-b099-c9477597b494 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:50.848566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:50.849194 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.849473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.849765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.850584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:50.853068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:50.879659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1028/2066] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:47:50 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:47:50.883668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:50.893252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45829ae8-cf0f-4550-871e-e23de23ca56c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:50.947958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:50.948615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.948877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.949129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.949961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:50.951913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:50.971107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1039/2067] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:47:50 2021] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:47:50.975205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:50.985893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63511d-9edc-4372-8dd3-63891ca12332 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:50.990465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:50.991147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:50.991423 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:50.991695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:50.993017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:50.994688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:51.005344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1029/2068] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:51.009773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:51.019566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a612-3ee7-4129-b5c5-ae6fbd2c4c97 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:51.024680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:51.025317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:51.025595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:51.025897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:51.026668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:51.028502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d821b-807e-44d9-b447-184b72004518 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:51.038228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1040/2069] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:47:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:47:51.042111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:51.052477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13485e6-f5bd-45d1-8088-8ffe515a307e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:51.057886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:51.058938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:51.059275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:51.059548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] PATH_INFO: `/v3/projects/0d70019a05804e90a63277e4b58d1445/users/f16df44d2b9d46d0b71b8b0c0e6a7ade/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:51.075012 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d70019a05804e90a63277e4b58d1445, user_id=f16df44d2b9d46d0b71b8b0c0e6a7ade, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:51.077652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:51.089634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1030/2070] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:47:51 2021] PUT /identity/v3/projects/0d70019a05804e90a63277e4b58d1445/users/f16df44d2b9d46d0b71b8b0c0e6a7ade/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:47:51.100363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:51.100651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:51.100927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:51.126957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] MFA Rules not processed for user `f16df44d2b9d46d0b71b8b0c0e6a7ade`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:47:51.128164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:51.189821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1041/2071] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:47:51 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:47:51.203416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:47:51.205351 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:47:51.276867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d548-a6bf-4a25-9983-0ce3420b4e04 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:47:51.280450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:47:51.281079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:47:51.281364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:47:51.281633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:47:51.289536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:47:51.294261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287c8f-7123-426e-899d-14874d3ac8be service glance] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:47:51.299942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1031/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:47:51 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:00.806890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:00.808911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:00.872103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef18b-ddd8-438f-81af-40e0e770a0f0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:00.878281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:00.879329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:00.879606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:00.879876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] PATH_INFO: `/v3/users/898c4666dff04eee89ce2bde0a74a1a4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:00.881750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898c4666dff04eee89ce2bde0a74a1a4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:00.884885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:00.935391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898c4666dff04eee89ce2bde0a74a1a4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:00.942705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898c4666dff04eee89ce2bde0a74a1a4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:00.949839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898c4666dff04eee89ce2bde0a74a1a4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:00.962031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898c4666dff04eee89ce2bde0a74a1a4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:00.962761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898c4666dff04eee89ce2bde0a74a1a4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:00.969369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1042/2073] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:00 2021] DELETE /identity/v3/users/898c4666dff04eee89ce2bde0a74a1a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:00.974055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:00.974609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:00.974609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:00.997638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:00.998896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:01.061844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1032/2074] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:01.072556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.073964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:01.127059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d99e-732d-4331-aca8-3fd7c912b989 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.130682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.131310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.131585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.131854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.141107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.142528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269504ff-2ca3-4e51-a876-5d8b831a5f16 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.152437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1043/2075] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:01.420843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.422428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:01.435867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1109ea8-04d6-40ed-a986-947af1856bd0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.440898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.441754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.442029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.442292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] PATH_INFO: `/v3/projects/15bba1ec64de4d0da5d6bab1ba396fe8` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.443556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15bba1ec64de4d0da5d6bab1ba396fe8)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.445739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.490395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bba1ec64de4d0da5d6bab1ba396fe8', 'request_id': 'req-28b92053-03bb-4b7b-86ab-73c85ed3e917'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:01.497375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bba1ec64de4d0da5d6bab1ba396fe8', 'request_id': 'req-28b92053-03bb-4b7b-86ab-73c85ed3e917'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:01.504132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bba1ec64de4d0da5d6bab1ba396fe8', 'request_id': 'req-28b92053-03bb-4b7b-86ab-73c85ed3e917'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:01.516512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] The token cache is being invalidate because project 15bba1ec64de4d0da5d6bab1ba396fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:01.516796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:01.517410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-28b92053-03bb-4b7b-86ab-73c85ed3e917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:01.519005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1033/2076] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:01 2021] DELETE /identity/v3/projects/15bba1ec64de4d0da5d6bab1ba396fe8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:01.525183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.525493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.525762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.549678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:01.551479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:01.610535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1044/2077] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:01.618512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.618831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.619112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.639323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:01.640560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:01.648980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1034/2078] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:01.653398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.663094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf4bdc-20d5-49f1-8b9b-48736c76b513 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.668255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.668901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.669179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.669450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.670184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:48:01.670485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.672096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.683676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1045/2079] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:48:01.687736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.697146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92bb7-aba2-49d6-a4c2-b17741526f6a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.701623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.702254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.702530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.702829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.703531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.705412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.730102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1035/2080] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:01 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:01.734119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.744205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f647e-6474-45a9-8bc0-928ae2a47149 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.806380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.807086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.807678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.807678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.808398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.810263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.833414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1046/2081] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:01 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:01.837509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.847584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486f811-5f8a-4602-af8b-0a827b16c4e8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.852178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.852824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.853105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.853378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.854186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.855806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.869432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1036/2082] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:01.870604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.880632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f55c-ef5a-4598-b123-7dbbab47d72b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.885781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.886434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.886741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.887013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.887878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.889457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4471-c9f0-4ab9-99f2-825a2c57c935 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.899325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1047/2083] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:48:01.903603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:01.913253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae42e44-4134-49c6-94eb-53142fe0ea18 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:01.919137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:01.920017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.920293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.920566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] PATH_INFO: `/v3/projects/a29eef87fe0a43c587558eac84c96040/users/f50653b0917449ee93a2b813a4dac4c1/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.935805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29eef87fe0a43c587558eac84c96040, user_id=f50653b0917449ee93a2b813a4dac4c1, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:01.938417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:01.952745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1037/2084] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:01 2021] PUT /identity/v3/projects/a29eef87fe0a43c587558eac84c96040/users/f50653b0917449ee93a2b813a4dac4c1/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:01.964312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:01.964634 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:01.964948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:01.991469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] MFA Rules not processed for user `f50653b0917449ee93a2b813a4dac4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:01.993212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:02.059985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1048/2085] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:01 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:02.064844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.125869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928146-16bc-4f02-9b7f-93f42317fbfc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.131467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.132152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.132437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.132702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.133713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.135467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.167843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1038/2086] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:02.173114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.189415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd5331-7334-4f16-858a-8a0cc2fd9506 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.252181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.252953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.253285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.253563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.254336 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.256636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.281154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1049/2087] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:48:02.285263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.295883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4262b-854f-4a12-8df8-bdce6ff7108f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.300477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.301117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.301398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.301676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.302410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.304073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.314144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1039/2088] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:02.317848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.327274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7717a-f815-4ed3-904e-86072e532d50 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.333008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.333670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.333977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.334257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.335040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.337380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929585-3629-4217-90bb-65a7a443ebba admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.348174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1050/2089] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:02.352678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.362469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330a34-601f-454f-9ece-1edb9acb0508 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.367058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.367926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.368231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.368503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] PATH_INFO: `/v3/projects/b4e5e6f048a940d6b25358a6d4723d0c/users/3c2d2e4fd6354f90afeeff0c0b6bc124/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.383149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e5e6f048a940d6b25358a6d4723d0c, user_id=3c2d2e4fd6354f90afeeff0c0b6bc124, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.385818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.399321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1040/2090] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:02 2021] PUT /identity/v3/projects/b4e5e6f048a940d6b25358a6d4723d0c/users/3c2d2e4fd6354f90afeeff0c0b6bc124/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:02.410256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.410559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.410848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.436740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] MFA Rules not processed for user `3c2d2e4fd6354f90afeeff0c0b6bc124`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:02.437944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:02.505316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1051/2091] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:02.509818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.599326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa006-7d39-42d6-b16c-679272c8e6e9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.605685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.606508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.606829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.607108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.607898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.609911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.643533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1041/2092] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:02.645204 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.657325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a1b1-254a-4489-bd70-9fc0150099d4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.720403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.721069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.721526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.721808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.723325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.725227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.750105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1052/2093] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:48:02.751405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.765278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6024e0-ce36-4122-ba6d-62e9c8148978 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.770916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.771660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.771945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.772216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.773539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.775151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.786077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1042/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:02.790170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.801433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471716c3-ef7a-4b13-af72-c154b7576c74 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.814649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.815559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.815868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.816140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] PATH_INFO: `/v3/projects/95747bd2912d456088becd84fc3feafb/users/0319dd9ab53e47d388b52912304f66c1/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.831491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95747bd2912d456088becd84fc3feafb, user_id=0319dd9ab53e47d388b52912304f66c1, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.834303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.852725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1053/2095] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:02 2021] PUT /identity/v3/projects/95747bd2912d456088becd84fc3feafb/users/0319dd9ab53e47d388b52912304f66c1/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:02.858476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.869316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ac91e-e1c9-400c-bde1-50266f13c1b6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.931192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.931897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.932175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.932448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.933205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.934847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b814ad0-cf55-4a27-80d9-20dc702fa0eb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.949241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1043/2096] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:02.950402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:02.961277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0a63-e0db-4e77-b9c9-7bf79de44897 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:02.967338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:02.967729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.968013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.968284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] PATH_INFO: `/v3/projects/95747bd2912d456088becd84fc3feafb/users/0319dd9ab53e47d388b52912304f66c1/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:02.971288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95747bd2912d456088becd84fc3feafb, user_id=0319dd9ab53e47d388b52912304f66c1, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:02.974000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:02.986244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1054/2097] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:02 2021] PUT /identity/v3/projects/95747bd2912d456088becd84fc3feafb/users/0319dd9ab53e47d388b52912304f66c1/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:02.997307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:02.997600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:02.997876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:03.027449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] MFA Rules not processed for user `0319dd9ab53e47d388b52912304f66c1`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:03.028703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:03.106839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1044/2098] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:02 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:03.117742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:03.119493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:03.181609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1892-66fb-4e68-8a39-21fbd4ba52b0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:03.188560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:03.189439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:03.189752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:03.190036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:03.260884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:03.263137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:03.295928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1055/2099] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:03 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:04.833781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:04.835225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:04.847421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27dc15-97c9-450f-aebe-89c968ff46f9 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:04.851364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:04.851997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:04.852274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:04.852544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:04.914763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:04.916212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:04.934762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1045/2100] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:04 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:05.542685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:05.550963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f9ee-2e55-458b-9124-19ae66571994 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:05.555111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:05.555748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:05.556116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:05.556306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:05.571814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:05.574281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c3786-cb71-4341-a836-259a88ac03f2 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:05.585640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1056/2101] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:05 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:08.366100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:08.367586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:08.432946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553268fe-cebd-44c9-83fd-fd5bbdedf006 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:08.437635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:08.438499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:08.438810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:08.439086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] PATH_INFO: `/v3/users/4e5f42f158884a78bc8223e3480eee08` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:08.440300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5f42f158884a78bc8223e3480eee08)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:08.442228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:08.489051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5f42f158884a78bc8223e3480eee08'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.501004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5f42f158884a78bc8223e3480eee08'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.508294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5f42f158884a78bc8223e3480eee08'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.508957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5f42f158884a78bc8223e3480eee08'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.509554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5f42f158884a78bc8223e3480eee08'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.521472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1046/2102] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:08 2021] DELETE /identity/v3/users/4e5f42f158884a78bc8223e3480eee08 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:08.657462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8a27-7106-420f-9e93-0c89547f7a1a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:08.657964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8a27-7106-420f-9e93-0c89547f7a1a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:08.658065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8a27-7106-420f-9e93-0c89547f7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:08.676099 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-317e8a27-7106-420f-9e93-0c89547f7a1a None None] MFA Rules not processed for user `a89417ea7c7442289745cb1851eccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:08.677276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-317e8a27-7106-420f-9e93-0c89547f7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:08.709092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:08.711724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:08.735183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1057/2103] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:08.789278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2717d2-ddd1-4b41-beb2-e85da7ac5c9d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:08.794183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:08.795121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:08.795398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:08.795668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] PATH_INFO: `/v3/projects/d2ca83134dcd40a7887485fcf5bca190` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:08.797000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ca83134dcd40a7887485fcf5bca190)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:08.798744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:08.843641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ca83134dcd40a7887485fcf5bca190', 'request_id': 'req-72160f97-5900-485f-9ed6-020347360d51'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.848737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ca83134dcd40a7887485fcf5bca190', 'request_id': 'req-72160f97-5900-485f-9ed6-020347360d51'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.855261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ca83134dcd40a7887485fcf5bca190', 'request_id': 'req-72160f97-5900-485f-9ed6-020347360d51'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.870586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] The token cache is being invalidate because project d2ca83134dcd40a7887485fcf5bca190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:08.870586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.870586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-72160f97-5900-485f-9ed6-020347360d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:08.873180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1047/2104] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:08 2021] DELETE /identity/v3/projects/d2ca83134dcd40a7887485fcf5bca190 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:08.877597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:08.877887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:08.878164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:08.897800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:08.899038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:08.955083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1058/2105] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:08.963875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:08.964541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:08.964820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:08.990793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:08.992637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:09.014204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1048/2106] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:09.018437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.030222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d32d-79d7-4210-bc30-c259f32cd5d3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.035643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.036295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.036577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.036902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.037731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:48:09.038062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.040388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.056981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1059/2107] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:48:09.058042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.068839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1535d3a-6519-4c62-baaf-f9f7b4ad511c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.076540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.077199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.077577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.077871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.078595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.080601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.113134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1049/2108] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:09 2021] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:09.114660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.125629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a54f3-8f59-449f-abb9-f35029e47a9e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.192944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.193904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.194187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.194519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.195429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.197318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.219266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1060/2109] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:09 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:48:09.225686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.236783 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015973a-31c4-4398-bebb-f7b727349663 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.246729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.246729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.246729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.246729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.247104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.247104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.258615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1050/2110] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:09.262130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.275048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb4b81-799c-4573-bf65-d9fc3afea25c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.281127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.282040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.282320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.282618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.283685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.285298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be12427-754c-4e21-8e2c-8df48b32e00f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.296783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1061/2111] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:09.301208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.311887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafacc0-a343-4cd3-876d-0302cf6e04ed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.320854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.322454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.324166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.326728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] PATH_INFO: `/v3/projects/c898dae86fd145c7bf0a0d90efe560eb/users/a7acad3852514d64be0969ac7bf19221/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.350267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c898dae86fd145c7bf0a0d90efe560eb, user_id=a7acad3852514d64be0969ac7bf19221, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.353585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.367998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1051/2112] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:09 2021] PUT /identity/v3/projects/c898dae86fd145c7bf0a0d90efe560eb/users/a7acad3852514d64be0969ac7bf19221/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:09.374406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.375225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.375689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.396652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:09.398588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:09.473203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1062/2113] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:09.486334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:09.488708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:09.555938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7830b-7bd0-45db-afd7-009d2335a833 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:09.559756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:09.560477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:09.560925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:09.561162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:09.571668 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:09.573684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665216b-1288-4736-a965-ce3f7d84a196 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:09.588802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1052/2114] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:10.622818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:10.626039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:10.641309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0e4e-a6c2-47d3-80a6-197e02d3c608 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:10.648806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:10.650879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:10.651404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:10.651840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] PATH_INFO: `/v3/users/f50653b0917449ee93a2b813a4dac4c1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:10.653774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50653b0917449ee93a2b813a4dac4c1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:10.662615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:10.727590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50653b0917449ee93a2b813a4dac4c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:10.739519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50653b0917449ee93a2b813a4dac4c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:10.752790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50653b0917449ee93a2b813a4dac4c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:10.770364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50653b0917449ee93a2b813a4dac4c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:10.771653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50653b0917449ee93a2b813a4dac4c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:10.791925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1063/2115] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:10 2021] DELETE /identity/v3/users/f50653b0917449ee93a2b813a4dac4c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:10.796711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:10.797204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:10.797456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:10.840114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:10.841897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:10.926107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1053/2116] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:10.948056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:10.948056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:11.039658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00966f-6f22-4a83-9810-b67abed518d4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:11.044171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:11.046646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:11.046646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:11.046646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:11.055868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:11.057319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:11.067460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1064/2117] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:11.661579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:11.663042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:11.675427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61f27-ec64-49f2-b7c7-9e443e8f0536 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:11.680070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:11.681107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:11.681383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:11.681652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] PATH_INFO: `/v3/projects/a29eef87fe0a43c587558eac84c96040` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:11.682880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29eef87fe0a43c587558eac84c96040)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:11.684795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:11.738419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29eef87fe0a43c587558eac84c96040', 'request_id': 'req-782376f0-a410-4a2d-8545-35215c42da9d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.743687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29eef87fe0a43c587558eac84c96040', 'request_id': 'req-782376f0-a410-4a2d-8545-35215c42da9d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.749723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29eef87fe0a43c587558eac84c96040', 'request_id': 'req-782376f0-a410-4a2d-8545-35215c42da9d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.768048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] The token cache is being invalidate because project a29eef87fe0a43c587558eac84c96040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:11.768628 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.769812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.775446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1054/2118] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:11 2021] DELETE /identity/v3/projects/a29eef87fe0a43c587558eac84c96040 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:11.778467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:11.792535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e855-d02c-43d0-a245-15a1babda005 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:11.869611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:11.870645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:11.870942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:11.872306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] PATH_INFO: `/v3/users/3c2d2e4fd6354f90afeeff0c0b6bc124` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:11.874023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2d2e4fd6354f90afeeff0c0b6bc124)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:11.878325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:11.950575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2d2e4fd6354f90afeeff0c0b6bc124'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.963570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2d2e4fd6354f90afeeff0c0b6bc124'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.978273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2d2e4fd6354f90afeeff0c0b6bc124'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:11.998928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2d2e4fd6354f90afeeff0c0b6bc124'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.000225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2d2e4fd6354f90afeeff0c0b6bc124'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.017788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1065/2119] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:11 2021] DELETE /identity/v3/users/3c2d2e4fd6354f90afeeff0c0b6bc124 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:12.361852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:12.363920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:12.379723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782376f0-a410-4a2d-8545-35215c42da9d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:12.451108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:12.452237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:12.452510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:12.452775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] PATH_INFO: `/v3/projects/b4e5e6f048a940d6b25358a6d4723d0c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:12.454019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e5e6f048a940d6b25358a6d4723d0c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:12.455992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:12.515032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e5e6f048a940d6b25358a6d4723d0c', 'request_id': 'req-5f901b97-c3c6-4222-ae8b-24092512a9eb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.524804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e5e6f048a940d6b25358a6d4723d0c', 'request_id': 'req-5f901b97-c3c6-4222-ae8b-24092512a9eb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.535825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e5e6f048a940d6b25358a6d4723d0c', 'request_id': 'req-5f901b97-c3c6-4222-ae8b-24092512a9eb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.558049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] The token cache is being invalidate because project b4e5e6f048a940d6b25358a6d4723d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:12.558421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.559968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.563810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1055/2120] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:12 2021] DELETE /identity/v3/projects/b4e5e6f048a940d6b25358a6d4723d0c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:12.568044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:12.573551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:12.593511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1c6f-3187-46c4-b7bf-5206c230ae11 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:12.653363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:12.654613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:12.654973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:12.655900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] PATH_INFO: `/v3/users/0319dd9ab53e47d388b52912304f66c1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:12.657344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0319dd9ab53e47d388b52912304f66c1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:12.659685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:12.736139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0319dd9ab53e47d388b52912304f66c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.747436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0319dd9ab53e47d388b52912304f66c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.756471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0319dd9ab53e47d388b52912304f66c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.787165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0319dd9ab53e47d388b52912304f66c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.789192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-93d38874-06be-4da1-8362-f8bca7ce0028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0319dd9ab53e47d388b52912304f66c1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:12.797008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1066/2121] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:12 2021] DELETE /identity/v3/users/0319dd9ab53e47d388b52912304f66c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:13.141936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.144435 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:13.171759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f901b97-c3c6-4222-ae8b-24092512a9eb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.270918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.271856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.272218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.273385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] PATH_INFO: `/v3/projects/95747bd2912d456088becd84fc3feafb` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.275463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95747bd2912d456088becd84fc3feafb)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.278529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.362482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95747bd2912d456088becd84fc3feafb', 'request_id': 'req-efb5a917-656d-4862-9c13-69c676234846'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:13.372600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95747bd2912d456088becd84fc3feafb', 'request_id': 'req-efb5a917-656d-4862-9c13-69c676234846'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:13.389384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95747bd2912d456088becd84fc3feafb', 'request_id': 'req-efb5a917-656d-4862-9c13-69c676234846'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:13.415327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] The token cache is being invalidate because project 95747bd2912d456088becd84fc3feafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:13.415612 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:13.421566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-efb5a917-656d-4862-9c13-69c676234846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:13.423212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1056/2122] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:13 2021] DELETE /identity/v3/projects/95747bd2912d456088becd84fc3feafb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:13.430027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.430333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.430835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.478793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:13.480718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:13.574311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1067/2123] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:13.582449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715505be-9b9c-4610-9842-da2a962998cb None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.582880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715505be-9b9c-4610-9842-da2a962998cb None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.583241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715505be-9b9c-4610-9842-da2a962998cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.602271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-715505be-9b9c-4610-9842-da2a962998cb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:13.603523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-715505be-9b9c-4610-9842-da2a962998cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:13.614613 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1057/2124] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:13.619396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.629428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fef859-e141-44d9-9bf5-dddfc6f41785 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.634744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.635390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.635668 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.635936 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.636666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:48:13.636963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.638949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.651268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1068/2125] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:48:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:48:13.655340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715505be-9b9c-4610-9842-da2a962998cb None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.665374 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715505be-9b9c-4610-9842-da2a962998cb None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.671118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.671885 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.672478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.672727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.673510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.675566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.722339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1058/2126] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:13 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:48:13.726581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.739299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e4db8-2a83-4eed-ad59-fd8e303a581e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.814910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.816281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.816566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.816886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.817932 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.821247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.849556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1069/2127] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:13 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:48:13.849969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.863524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600d341-e9a2-4e32-8616-5cf0145999ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.871562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.872851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.873328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.873711 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.875256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.878789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.898653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1059/2128] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:48:13.903115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.916067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b26e-06f2-47fb-becc-405b76d0f908 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.923326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.924346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.924761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.925139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:13.926213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:13.928248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d816b96-1ef3-4191-a5ed-497aba9a0b6f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:13.947587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1070/2129] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:13 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:13.948269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:13.961169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182d06-f02a-4cbb-a027-db98d1ff9867 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:13.970229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:13.971998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:13.972385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:13.972765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] PATH_INFO: `/v3/projects/24a77acac2a54ceeb947ffdcd4528b3d/users/9dbd2e22595b41d0a1ffb13436c85add/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:14.027038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a77acac2a54ceeb947ffdcd4528b3d, user_id=9dbd2e22595b41d0a1ffb13436c85add, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:14.030990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:14.067066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1060/2130] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:13 2021] PUT /identity/v3/projects/24a77acac2a54ceeb947ffdcd4528b3d/users/9dbd2e22595b41d0a1ffb13436c85add/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:14.073240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c72e0-16dc-4b8d-846f-74300ec03f87 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:14.073592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c72e0-16dc-4b8d-846f-74300ec03f87 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:14.073942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c72e0-16dc-4b8d-846f-74300ec03f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:14.110662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2b4c72e0-16dc-4b8d-846f-74300ec03f87 None None] MFA Rules not processed for user `9dbd2e22595b41d0a1ffb13436c85add`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:14.113513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2b4c72e0-16dc-4b8d-846f-74300ec03f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:14.202964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1071/2131] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:14.222140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:14.224123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:14.300144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab46b9-90fb-4b79-b942-deae4a06db5f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:14.304114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:14.304775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:14.305058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:14.305336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:14.316261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:14.316951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:14.330318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1061/2132] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:14 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:15.782152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cbfe6-acab-4eb0-aad4-670ff6f9bd18 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:15.782739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cbfe6-acab-4eb0-aad4-670ff6f9bd18 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:15.782739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cbfe6-acab-4eb0-aad4-670ff6f9bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:15.810851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ed5cbfe6-acab-4eb0-aad4-670ff6f9bd18 None None] MFA Rules not processed for user `a7acad3852514d64be0969ac7bf19221`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:15.812135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ed5cbfe6-acab-4eb0-aad4-670ff6f9bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:15.877778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1072/2133] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:15 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:15.890961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:15.892643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:15.980424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a68f4-09e5-4486-ba10-89c2ef04db41 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:15.986126 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:15.986813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:15.992647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:15.992647 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:15.997727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:15.999464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:16.010989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1062/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:15 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:17.775279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78d7b-b15b-42d1-b6fb-3863651a512a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:17.776118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78d7b-b15b-42d1-b6fb-3863651a512a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:17.776589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78d7b-b15b-42d1-b6fb-3863651a512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:17.798865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-32c78d7b-b15b-42d1-b6fb-3863651a512a None None] MFA Rules not processed for user `a7acad3852514d64be0969ac7bf19221`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:17.800106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-32c78d7b-b15b-42d1-b6fb-3863651a512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:17.808847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1073/2135] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:17 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:26.459309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:26.460785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:26.523049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04244-5ac7-489f-b7fa-522c95aad371 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:26.527691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:26.528456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:26.528735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:26.529022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] PATH_INFO: `/v3/users/fa03f284337a415abef8eb9fcd59abde` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:26.530207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa03f284337a415abef8eb9fcd59abde)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:26.532203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:26.584870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa03f284337a415abef8eb9fcd59abde'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:26.595713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa03f284337a415abef8eb9fcd59abde'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:26.602565 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa03f284337a415abef8eb9fcd59abde'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:26.603223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa03f284337a415abef8eb9fcd59abde'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:26.603810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa03f284337a415abef8eb9fcd59abde'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:26.616469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1063/2136] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:26 2021] DELETE /identity/v3/users/fa03f284337a415abef8eb9fcd59abde => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:26.620925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:26.621468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:26.621572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:26.638755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:26.639895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:26.697271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1074/2137] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:26.707293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:26.708812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:26.898510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735de89-14be-4957-a929-d28bbbf368ae admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:26.902046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:26.902723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:26.903006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:26.903278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:26.912227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:26.914233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dd81-26eb-44c5-bfee-f886837b3a37 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:26.923741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1064/2138] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:27.228075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.229510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.244332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6679b7-770a-4e74-b4a1-603ac889eb2f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.249152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.250334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.250718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.251063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] PATH_INFO: `/v3/projects/9ca133e69a124f128c2a0765f400fae7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.252339 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca133e69a124f128c2a0765f400fae7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.255392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.299514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca133e69a124f128c2a0765f400fae7', 'request_id': 'req-fdb7f219-5704-473e-8bb0-1d4696ad8e41'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.305094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca133e69a124f128c2a0765f400fae7', 'request_id': 'req-fdb7f219-5704-473e-8bb0-1d4696ad8e41'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.311942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca133e69a124f128c2a0765f400fae7', 'request_id': 'req-fdb7f219-5704-473e-8bb0-1d4696ad8e41'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.322487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] The token cache is being invalidate because project 9ca133e69a124f128c2a0765f400fae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:27.322821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.323425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-fdb7f219-5704-473e-8bb0-1d4696ad8e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.324949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1075/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:27 2021] DELETE /identity/v3/projects/9ca133e69a124f128c2a0765f400fae7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:27.330673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.330965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.331239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.348279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:27.349468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.404132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1065/2140] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:27.412483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.413269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.413543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.431582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:27.432753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.440443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1076/2141] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:27.444441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.453728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e48e-9562-4cf8-a2ce-ad1028493199 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.458233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.458901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.459184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.459938 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.460710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:48:27.461015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.462618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.474651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1066/2142] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:48:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:48:27.479428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.488161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12968c-64d3-4d38-8b56-bc04799e2423 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.492800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.493432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.493713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.494059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.494875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.496901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.523676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1077/2143] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:27.527795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.537278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473e58-a46e-40ea-b676-9b2fa76aac82 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.600847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.601673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.602016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.602366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.603465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.605659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.626037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1067/2144] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:48:27.630327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.643364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8f02-13af-415c-a3f2-6b8cf4f3e6f4 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.649729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.650521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.650903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.651308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.652101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.657250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.674810 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1078/2145] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:27.677380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.690982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d3fee-4527-47ab-a45e-55d79ddc0dcd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.699210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.700325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.700967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.701952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.703232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.705436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed9657-2d28-4718-95dc-a180898c9db4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.721633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1068/2146] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:48:27.722300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.732810 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a61f-eb97-45fa-b418-24a9c83f74ed admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.737455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.738327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.738791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.738925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] PATH_INFO: `/v3/projects/55b0b1fbfa48461dbe73523f1557f875/users/768c02d17606458ea666252be580802c/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.754170 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b0b1fbfa48461dbe73523f1557f875, user_id=768c02d17606458ea666252be580802c, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.756930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.769788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1079/2147] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:48:27 2021] PUT /identity/v3/projects/55b0b1fbfa48461dbe73523f1557f875/users/768c02d17606458ea666252be580802c/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:48:27.775302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.775589 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.775864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.793272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:27.794447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.857497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1069/2148] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:27.862215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.864021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.864870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:27.866632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:27.878426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbd380-2558-45d1-a798-86c4d8faf7ca admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.883760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.884611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.884896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.885174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] PATH_INFO: `/v3/users/9dbd2e22595b41d0a1ffb13436c85add` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.886388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbd2e22595b41d0a1ffb13436c85add)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.888326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.923704 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811261-ed3c-44ee-b171-0b68a8f1f0b7 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:27.928125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:27.928842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.929118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.929386 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:27.937967 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbd2e22595b41d0a1ffb13436c85add'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.938796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:27.941074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba8bc-97e2-4b58-89c0-95f68196306f service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:27.952683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbd2e22595b41d0a1ffb13436c85add'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.955428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1070/2149] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:27.961293 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbd2e22595b41d0a1ffb13436c85add'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.972753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbd2e22595b41d0a1ffb13436c85add'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.973490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbd2e22595b41d0a1ffb13436c85add'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:27.980815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1080/2150] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:48:27 2021] DELETE /identity/v3/users/9dbd2e22595b41d0a1ffb13436c85add => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:27.984380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:27.984914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:27.985372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:28.004687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:28.005905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:28.069956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1071/2151] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:28.086790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:28.088579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:28.179642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da34e-1aa8-47a3-a6d1-c47bf6a0f54b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:28.186808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:28.187664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:28.187945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:28.188549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:28.212246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:28.213697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0262fd3-2310-401b-8aa1-17aecc37ab55 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:28.225798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1081/2152] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:28.827569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:28.830272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:28.845675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bebaa4-d20a-4223-b10d-0ea64990c0ae None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:28.852753 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:28.853210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:28.853667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:28.854000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] PATH_INFO: `/v3/projects/24a77acac2a54ceeb947ffdcd4528b3d` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:28.856749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a77acac2a54ceeb947ffdcd4528b3d)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:28.860107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:28.896401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508590b-42f5-428e-8943-ce6bad5607de None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:28.897347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508590b-42f5-428e-8943-ce6bad5607de None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:28.897822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508590b-42f5-428e-8943-ce6bad5607de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:28.935015 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1508590b-42f5-428e-8943-ce6bad5607de None None] MFA Rules not processed for user `768c02d17606458ea666252be580802c`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:28.936433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1508590b-42f5-428e-8943-ce6bad5607de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:28.951695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a77acac2a54ceeb947ffdcd4528b3d', 'request_id': 'req-9e573bfa-f54e-4165-9903-e1151188ad42'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:28.957291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a77acac2a54ceeb947ffdcd4528b3d', 'request_id': 'req-9e573bfa-f54e-4165-9903-e1151188ad42'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:28.963831 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a77acac2a54ceeb947ffdcd4528b3d', 'request_id': 'req-9e573bfa-f54e-4165-9903-e1151188ad42'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:28.977221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] The token cache is being invalidate because project 24a77acac2a54ceeb947ffdcd4528b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:48:28.977566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:28.978514 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:48:28.980342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1072/2153] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:48:28 2021] DELETE /identity/v3/projects/24a77acac2a54ceeb947ffdcd4528b3d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:48:29.035838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1082/2154] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:28 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:48:29.045369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:48:29.047172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:29.124354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573bfa-f54e-4165-9903-e1151188ad42 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:48:29.132292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:48:29.132961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:29.133241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:29.133519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:29.143214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:48:29.144729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db1ef-5ad1-415f-84c5-a267f36a13b4 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:48:29.155125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1073/2155] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:48:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:48:31.533681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:31.534198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:31.534323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:31.552751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] MFA Rules not processed for user `768c02d17606458ea666252be580802c`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:31.554451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:31.561188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1083/2156] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:31 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:48:57.443735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561c0a-e918-43ce-871b-0f81e1b7e5bc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:48:57.444309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561c0a-e918-43ce-871b-0f81e1b7e5bc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:48:57.444309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561c0a-e918-43ce-871b-0f81e1b7e5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:48:57.474965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8e561c0a-e918-43ce-871b-0f81e1b7e5bc None None] MFA Rules not processed for user `a89417ea7c7442289745cb1851eccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:48:57.476323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8e561c0a-e918-43ce-871b-0f81e1b7e5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:48:57.544899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1074/2157] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:48:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:00.494356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:00.495928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:00.669163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d671d38-c27c-4cc6-84bf-3fe40f9e57fa None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:00.673650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:00.674503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:00.674808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:00.675083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] PATH_INFO: `/v3/users/f16df44d2b9d46d0b71b8b0c0e6a7ade` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:00.676269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16df44d2b9d46d0b71b8b0c0e6a7ade)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:00.678164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:00.740253 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16df44d2b9d46d0b71b8b0c0e6a7ade'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:00.749901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16df44d2b9d46d0b71b8b0c0e6a7ade'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:00.756896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16df44d2b9d46d0b71b8b0c0e6a7ade'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:00.768341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16df44d2b9d46d0b71b8b0c0e6a7ade'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:00.768974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16df44d2b9d46d0b71b8b0c0e6a7ade'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:00.775258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1084/2158] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:49:00 2021] DELETE /identity/v3/users/f16df44d2b9d46d0b71b8b0c0e6a7ade => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:49:00.779703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:00.780187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:00.780289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:00.804809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:00.806003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:00.863100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1075/2159] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:00.878758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:00.880294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:00.980194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e23b-fd61-4f6e-aed0-82348d5fbce5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:00.983720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:00.984359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:00.984633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:00.984904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:00.998032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:00.999790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164676-d1da-4727-a7a9-9550cb06ef4e service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.010474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1085/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:49:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:49:01.408192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.409801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:01.422979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afede6-be99-4805-af57-ca8978108ef2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.427604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.428639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.428974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.429268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] PATH_INFO: `/v3/projects/0d70019a05804e90a63277e4b58d1445` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.431085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d70019a05804e90a63277e4b58d1445)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.436375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.488137 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d70019a05804e90a63277e4b58d1445', 'request_id': 'req-f425ee2d-8391-46cf-b75e-1c74fd801cd9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:01.494267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d70019a05804e90a63277e4b58d1445', 'request_id': 'req-f425ee2d-8391-46cf-b75e-1c74fd801cd9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:01.500829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d70019a05804e90a63277e4b58d1445', 'request_id': 'req-f425ee2d-8391-46cf-b75e-1c74fd801cd9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:01.515106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] The token cache is being invalidate because project 0d70019a05804e90a63277e4b58d1445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:49:01.515393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:01.516006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f425ee2d-8391-46cf-b75e-1c74fd801cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:01.517516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1076/2161] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:49:01 2021] DELETE /identity/v3/projects/0d70019a05804e90a63277e4b58d1445 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:49:01.523203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.523688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.523688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.564327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:01.566633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:01.630876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1086/2162] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:01.638577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.639097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.639478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.660666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:01.662108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:01.672519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1077/2163] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:49:01.676088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.686732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa38c0-e8ab-469a-b977-6690f9d55a2d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.691356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.692006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.692285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.692559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.693294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:49:01.693620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.695314 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.706927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1087/2164] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:49:01.711199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.720254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2824d7-50c6-46cd-af9c-4a7ea4969ba4 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.724879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.725521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.725794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.726060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.727331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.729215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.756370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1078/2165] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:49:01 2021] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:49:01.761121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.771396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28095c-e520-465e-83f8-b75839f9a03c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.842264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.843615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.843913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.844190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.845130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.847051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.874987 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1088/2166] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:49:01 2021] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:49:01.878994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.889587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab3c9-fa51-43e0-8a8f-f67e4dfccf39 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.897702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.898367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.898732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.899008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.899743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.901364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.912242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1079/2167] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:49:01.916053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.927318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df291-efa4-4ff1-9c92-b3d49bfa11ef admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.939237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.939993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.940348 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.940694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.941508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:01.943265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73365d31-c4a9-4e8d-b93a-7bbed4f06a55 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:01.955685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1089/2168] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:49:01.959625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:01.975767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0c642-f3e3-4e44-bcbf-2df43af99898 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:01.981549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:01.982522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:01.982891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:01.983248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] PATH_INFO: `/v3/projects/ae961a402d4f4233a0b243e41bc4462e/users/115b18c552a142618c5ad793a713c22d/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:01.999609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae961a402d4f4233a0b243e41bc4462e, user_id=115b18c552a142618c5ad793a713c22d, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:02.002249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:02.016698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1080/2169] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:49:01 2021] PUT /identity/v3/projects/ae961a402d4f4233a0b243e41bc4462e/users/115b18c552a142618c5ad793a713c22d/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:49:02.028294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:02.028559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:02.028841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:02.057082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] MFA Rules not processed for user `115b18c552a142618c5ad793a713c22d`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:02.058278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:02.130706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1090/2170] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:02.143221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:02.144991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:02.201476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46090-518a-40f1-a402-84ae45ec5233 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:02.205212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:02.205863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:02.206145 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:02.206420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:02.215818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:02.217239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:02.225639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1081/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:49:02 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:49:30.203997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:30.205334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:30.298914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33d11-016b-4d65-b2be-a9080d50271d None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:30.304317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:30.305429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:30.305429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:30.305654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:30.307250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:30.318317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:30.319945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:30.330011 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1091/2172] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:49:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:49:59.310960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:59.312494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:59.378395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366bb8f-f5f9-4ff8-8c96-817dba456cba service glance] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:59.383225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:59.384219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.384502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.384770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] PATH_INFO: `/v3/users/0354a07d8de14ad4b2a90b5e0b9de8f4` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.386068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0354a07d8de14ad4b2a90b5e0b9de8f4)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:59.388164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:59.432255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0354a07d8de14ad4b2a90b5e0b9de8f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.445062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0354a07d8de14ad4b2a90b5e0b9de8f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.453276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0354a07d8de14ad4b2a90b5e0b9de8f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.454117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0354a07d8de14ad4b2a90b5e0b9de8f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.455085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-b25d9441-7064-4bf9-8e39-5e97f19d006b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0354a07d8de14ad4b2a90b5e0b9de8f4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.471063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1082/2173] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:49:59 2021] DELETE /identity/v3/users/0354a07d8de14ad4b2a90b5e0b9de8f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:49:59.649971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:59.661429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d41ba-b0d3-48cd-a04b-6436ad74644c service placement] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:59.720693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:59.721555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.721855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.722162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] PATH_INFO: `/v3/projects/9963cc9c643f4a5785f2cde5af79fd00` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.723648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9963cc9c643f4a5785f2cde5af79fd00)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:59.725519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:59.770525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9963cc9c643f4a5785f2cde5af79fd00', 'request_id': 'req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.776360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9963cc9c643f4a5785f2cde5af79fd00', 'request_id': 'req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.783645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9963cc9c643f4a5785f2cde5af79fd00', 'request_id': 'req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.795647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] The token cache is being invalidate because project 9963cc9c643f4a5785f2cde5af79fd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:49:59.795933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.796558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9ae5a5ad-498e-45f5-b43e-b7112caf5b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:49:59.798077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1092/2174] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:49:59 2021] DELETE /identity/v3/projects/9963cc9c643f4a5785f2cde5af79fd00 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:49:59.803857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.804148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.804426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.833099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:59.834293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:59.890461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1083/2175] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:59.898581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.898872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.899162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.917524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:49:59.918814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:49:59.927150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1093/2176] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:49:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:49:59.931315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:59.940854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea157-8d17-47f0-8f8a-f5afe97318b5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:59.945428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:59.946066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.946344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.946733 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.947468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:49:59.947826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:59.949402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:49:59.960563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1084/2177] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:49:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:49:59.964890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:49:59.974567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4877-f418-47bb-971c-3adb70f3cc3c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:49:59.982727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:49:59.983381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:49:59.983661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:49:59.983944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:49:59.985272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:49:59.987199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.012320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1094/2178] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:49:59 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:00.016995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.027793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9bbd0-1cfe-4c97-9e31-af9fd1199c90 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.083067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.083720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.084111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.084379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.085071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.086987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.107567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1085/2179] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:00 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:00.112203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.122941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55161c1-06a0-4d10-8665-89e22e4644f5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.127890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.128541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.128826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.129095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.129867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.131485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.141985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1095/2180] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:00.145841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.156439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c750f-47b7-4c38-b78a-89b01a86d4fc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.160977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.161627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.161907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.162208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.162983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.164561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa220-7ee2-409e-86e2-770bbf0116fb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.174909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1086/2181] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:00.179133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.188906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab3d5-5fbc-4ca9-9e1d-589798ae7312 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.193592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.194386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.194701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.194979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] PATH_INFO: `/v3/projects/c48810e492054c6fb7a10e13d2d4530b/users/bf9be237ef954c30b44d079fab9a7ad8/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.209315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48810e492054c6fb7a10e13d2d4530b, user_id=bf9be237ef954c30b44d079fab9a7ad8, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.211973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.225582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1096/2182] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:00 2021] PUT /identity/v3/projects/c48810e492054c6fb7a10e13d2d4530b/users/bf9be237ef954c30b44d079fab9a7ad8/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:00.236826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.237115 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.237392 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.267367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] MFA Rules not processed for user `bf9be237ef954c30b44d079fab9a7ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:00.268568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:00.327407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1087/2183] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:00 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:50:00.331826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.391305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75e6c-9b34-472d-be01-6ff422a2a124 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.398022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.398640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.398922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.399194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.399903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.401787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.426433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1097/2184] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:00 2021] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:00.430429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.440719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8553e0-5a71-46d9-b170-8ebeb325b1a6 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.495789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.496459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.496747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.497022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.497731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.499993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.521784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1088/2185] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:00 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:00.526198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.539771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769caf8-957c-4df9-abb2-b51228ea9d99 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.545209 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.545929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.546210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.546486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.547347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.548966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.559091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1098/2186] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:00.563294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.573738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93718017-6af8-4e75-a2b5-88083557024a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.579272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.580139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.580803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.581096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] PATH_INFO: `/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e/users/1cfa3e36ec3e42199fc903c9bf4421b9/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.598242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8c3c6f6f9f4fe78cd96d50df1de32e, user_id=1cfa3e36ec3e42199fc903c9bf4421b9, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.601226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.618959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1089/2187] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:00 2021] PUT /identity/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e/users/1cfa3e36ec3e42199fc903c9bf4421b9/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:00.624004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.633700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f827-3e00-4664-b5ff-9d25ec338e38 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.687657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.688366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.688697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.689127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.689986 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.691856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c75687-3585-4ac9-8be1-1b2e6667ce44 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.702947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1099/2188] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:00.707061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.716995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1cc79-ac6f-4a85-ad9d-921ed0e92a4e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.721878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.722804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.723084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.723358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] PATH_INFO: `/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e/users/1cfa3e36ec3e42199fc903c9bf4421b9/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.725438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8c3c6f6f9f4fe78cd96d50df1de32e, user_id=1cfa3e36ec3e42199fc903c9bf4421b9, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.728153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.738467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1090/2189] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:00 2021] PUT /identity/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e/users/1cfa3e36ec3e42199fc903c9bf4421b9/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:00.749187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.749630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.749926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.777277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] MFA Rules not processed for user `1cfa3e36ec3e42199fc903c9bf4421b9`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:00.778461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:00.842615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1100/2190] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:00 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:00.852887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:00.854571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:00.927698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ce0a-c9e8-45be-b53a-d32fd2d955d5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:00.931391 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:00.932018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:00.932294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:00.932564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:00.941812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:00.943187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21443b9a-b24e-4370-9865-935c8d923e90 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:00.952758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1091/2191] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:00 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:01.202577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:01.260188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7527a-fbb5-403c-a2f4-d147353a44f0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:01.265216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:01.266071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:01.266354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:01.266662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] PATH_INFO: `/v3/users/bf9be237ef954c30b44d079fab9a7ad8` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:01.267853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9be237ef954c30b44d079fab9a7ad8)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:01.269773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:01.320490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9be237ef954c30b44d079fab9a7ad8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.328268 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9be237ef954c30b44d079fab9a7ad8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.335202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9be237ef954c30b44d079fab9a7ad8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.347037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9be237ef954c30b44d079fab9a7ad8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.347673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9be237ef954c30b44d079fab9a7ad8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.353321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1101/2192] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:01 2021] DELETE /identity/v3/users/bf9be237ef954c30b44d079fab9a7ad8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:01.357861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:01.358316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:01.358430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:01.375255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:01.376427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:01.434716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1092/2193] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:01.444633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:01.446054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:01.500001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8d12-1dc2-45a4-ba94-fdf1597f8879 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:01.503589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:01.504210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:01.504486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:01.504756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:01.513569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:01.515195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:01.524785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1102/2194] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:01.793309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:01.795110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:01.808556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c99c6-ef4b-4b0c-966b-447dce857af1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:01.819225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:01.820219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:01.820824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:01.820824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] PATH_INFO: `/v3/projects/c48810e492054c6fb7a10e13d2d4530b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:01.824208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48810e492054c6fb7a10e13d2d4530b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:01.824208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:01.872357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48810e492054c6fb7a10e13d2d4530b', 'request_id': 'req-385b1042-f725-405c-a801-f9d05e55bb61'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.878691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48810e492054c6fb7a10e13d2d4530b', 'request_id': 'req-385b1042-f725-405c-a801-f9d05e55bb61'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.884736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48810e492054c6fb7a10e13d2d4530b', 'request_id': 'req-385b1042-f725-405c-a801-f9d05e55bb61'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.897414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] The token cache is being invalidate because project c48810e492054c6fb7a10e13d2d4530b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:01.897698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.898301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:01.899799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1093/2195] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:01 2021] DELETE /identity/v3/projects/c48810e492054c6fb7a10e13d2d4530b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:01.903748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:01.913666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a299-f536-4c10-8a26-57c1ae26756c service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:01.967148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:01.968501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:01.968779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:01.969058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] PATH_INFO: `/v3/users/1cfa3e36ec3e42199fc903c9bf4421b9` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:01.970254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfa3e36ec3e42199fc903c9bf4421b9)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:01.972191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.017722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfa3e36ec3e42199fc903c9bf4421b9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.024612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfa3e36ec3e42199fc903c9bf4421b9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.031799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfa3e36ec3e42199fc903c9bf4421b9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.042901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfa3e36ec3e42199fc903c9bf4421b9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.043531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9a9eb6d5-b91b-46e7-8544-ce285d6abdbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfa3e36ec3e42199fc903c9bf4421b9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.049212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1103/2196] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:01 2021] DELETE /identity/v3/users/1cfa3e36ec3e42199fc903c9bf4421b9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:02.322413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.324120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:02.339721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1042-f725-405c-a801-f9d05e55bb61 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.397918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.399298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.399584 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.399866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] PATH_INFO: `/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.401103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8c3c6f6f9f4fe78cd96d50df1de32e)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.403038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.450454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8c3c6f6f9f4fe78cd96d50df1de32e', 'request_id': 'req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.455734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8c3c6f6f9f4fe78cd96d50df1de32e', 'request_id': 'req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.462387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8c3c6f6f9f4fe78cd96d50df1de32e', 'request_id': 'req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.477326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] The token cache is being invalidate because project 5f8c3c6f6f9f4fe78cd96d50df1de32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:02.477618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.478242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-5e3b9eb6-ddc4-4370-ae5d-4e7df82424fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:02.479817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1094/2197] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:02 2021] DELETE /identity/v3/projects/5f8c3c6f6f9f4fe78cd96d50df1de32e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:02.486078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.486379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.486666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.504904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:02.506082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:02.562665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1104/2198] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:02.570814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.571104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.571383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.591104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:02.592383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:02.600948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1095/2199] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:02.605751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.615902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf2119-3cc7-4103-a1dc-d4da0727af07 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.624132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.624132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.624132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.624132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.624508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:02.624508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.624727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.636663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1105/2200] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:50:02.640898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.649847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cac7-0a38-4df6-813e-d6c5ba93085f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.655602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.656273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.656550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.656858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.657533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.659475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.682868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1096/2201] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:02 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:02.687030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.696808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37793-6796-4774-b73e-68c50ee665b6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.754047 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.754751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.755091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.755307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.756019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.757912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.776818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1106/2202] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:02 2021] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:02.781878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.791965 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307955b0-8b80-4a27-8cd1-2b1cb4b4d92c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.796673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.797326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.797605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.797879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.798649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.800243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.811034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1097/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:02.814937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.825877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7268-0f15-4a81-8983-d94ae7d1bc4f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.831080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.831760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.832038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.832312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.833054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.834752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fde75-99c9-4c57-adca-d0a3eab2d434 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.845160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1107/2204] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:50:02.849187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:02.858855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a45-20a3-4408-8931-5729ac7b9659 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:02.863346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:02.864192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.864462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.864727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] PATH_INFO: `/v3/projects/fd305a83d0834d8b9933846fea63c93b/users/a4a329bdf6c845fb8849936c221eec75/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.878837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd305a83d0834d8b9933846fea63c93b, user_id=a4a329bdf6c845fb8849936c221eec75, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:02.881685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:02.894880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1098/2205] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:02 2021] PUT /identity/v3/projects/fd305a83d0834d8b9933846fea63c93b/users/a4a329bdf6c845fb8849936c221eec75/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:02.905815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:02.906296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:02.906396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:02.933538 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] MFA Rules not processed for user `a4a329bdf6c845fb8849936c221eec75`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:02.934781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:03.001486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1108/2206] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:02 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:03.006122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.065497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6709a8-98c8-43e4-bced-bb25fa7e4f8e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.071541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.072193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.072472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.072746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.075359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.077842 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.103588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1099/2207] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:03 2021] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:03.107597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.117903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fea188-5cad-422a-9633-125e7a66f976 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.171378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.172081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.172362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.172638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.173343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.175337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.197093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1109/2208] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:03 2021] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:03.203160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.214071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f034bd-ca66-4f39-a74a-e03fc291b7f6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.218834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.219492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.219764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.220062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.220843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.222393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.234363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1100/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:03.238317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.248004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb310-0505-443c-9cf8-1d277780ac02 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.253786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.254738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.255084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.255354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] PATH_INFO: `/v3/projects/77d2f6367db84116901fcd56febc7914/users/12a5494d1853448f946813a232062bea/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.271765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d2f6367db84116901fcd56febc7914, user_id=12a5494d1853448f946813a232062bea, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.274603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.287216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1110/2210] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:03 2021] PUT /identity/v3/projects/77d2f6367db84116901fcd56febc7914/users/12a5494d1853448f946813a232062bea/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:03.291221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.301347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f94a8-7484-4cd0-b484-c7917e36f4fb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.354234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.354930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.355209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.355481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.356219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.358312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d631b1-dfa9-4b8e-bb62-43360f5985dc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.367649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1101/2211] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:03 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:03.371774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.382638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fa8a4-2646-4875-9249-53f549cb9c3c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.387223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.388081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.388363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.388639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] PATH_INFO: `/v3/projects/77d2f6367db84116901fcd56febc7914/users/12a5494d1853448f946813a232062bea/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.390768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d2f6367db84116901fcd56febc7914, user_id=12a5494d1853448f946813a232062bea, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.393370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.403251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1111/2212] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:03 2021] PUT /identity/v3/projects/77d2f6367db84116901fcd56febc7914/users/12a5494d1853448f946813a232062bea/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:03.413451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.413940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.414060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.443175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] MFA Rules not processed for user `12a5494d1853448f946813a232062bea`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:03.445248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:03.514919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1102/2213] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:03 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:03.525151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:03.526905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:03.582973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2b75-2033-475e-8fb4-8b57ddc107c0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:03.586526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:03.587238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:03.587513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:03.587781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:03.640019 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:03.641432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a08c-e172-47c2-a503-87dcd4a83b6e service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:03.650342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1112/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:50:05.157372 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:05.158889 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:05.222139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26063c3-674b-4833-9cfb-f66ce263aea5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:05.226764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:05.227618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:05.227891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:05.228159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] PATH_INFO: `/v3/users/115b18c552a142618c5ad793a713c22d` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:05.229377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115b18c552a142618c5ad793a713c22d)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:05.231307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:05.276914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115b18c552a142618c5ad793a713c22d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.288104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115b18c552a142618c5ad793a713c22d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.294510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115b18c552a142618c5ad793a713c22d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.295208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115b18c552a142618c5ad793a713c22d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.295807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115b18c552a142618c5ad793a713c22d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.308159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1103/2215] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:05 2021] DELETE /identity/v3/users/115b18c552a142618c5ad793a713c22d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:05.313231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:05.313702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:05.313817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:05.331498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:05.332701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:05.392527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1113/2216] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:50:05.403808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:05.405591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:05.479994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77b0a-2495-44c8-acbe-2fc610f8dca6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:05.484639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:05.485393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:05.486264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:05.486264 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:05.497959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:05.500227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42c8c-b026-4c3d-a052-4e2e1244864b service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:05.510643 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1104/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:05.835853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:05.838141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:05.853254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0861d1-2069-4c58-b658-e1e208de8898 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:05.862028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:05.863249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:05.863745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:05.864231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] PATH_INFO: `/v3/projects/ae961a402d4f4233a0b243e41bc4462e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:05.865715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae961a402d4f4233a0b243e41bc4462e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:05.870029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:05.927651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae961a402d4f4233a0b243e41bc4462e', 'request_id': 'req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.932856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae961a402d4f4233a0b243e41bc4462e', 'request_id': 'req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.940843 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae961a402d4f4233a0b243e41bc4462e', 'request_id': 'req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.953711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] The token cache is being invalidate because project ae961a402d4f4233a0b243e41bc4462e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:05.954088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.954921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a24cc6cb-c9eb-4ab1-8835-dbf27fe6840a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:05.956557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1114/2218] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:05 2021] DELETE /identity/v3/projects/ae961a402d4f4233a0b243e41bc4462e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:05.963469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:05.963758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:05.964042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:05.981450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:05.982731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.051641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1105/2219] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:06.055100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.055461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.055799 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.074981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:06.076196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.084171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1115/2220] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:06.088446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.099146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788473e-5934-4dfa-bfb2-4944044b3267 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.103824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.104510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.104787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.105059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.105794 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:06.106123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.108340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.119368 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1106/2221] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:50:06.123950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.132775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6c09-12db-4723-8443-14832ad21ed3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.137430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.138085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.138364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.138672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.139421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.141290 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.166474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1116/2222] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:06 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:06.171170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.185158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebe55-3510-4f17-95de-a779c57edd8b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.241293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.241945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.242216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.242481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.243234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.245106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.264964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1107/2223] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:06 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:06.269086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.279732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4aa9-8ef6-4669-ab74-a91deb8dd913 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.284366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.284999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.285275 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.285546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.286279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.287883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.298292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1117/2224] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:06.301868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.311258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120cb7-47a4-4b86-9418-2b5ed5fa44d3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.316089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.316660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.316936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.317207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.317928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.319804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95801aa7-13b8-4acc-ba06-c668caa34724 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.329507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1108/2225] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:06.333418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.343796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e386b1-5539-4204-9f2c-55627f1ff5bd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.348403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.349260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.349540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.349813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] PATH_INFO: `/v3/projects/64df4a6f818248098ecc9ff68f384917/users/aa2f31167a54472793ac29a2e5658d97/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.363613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=64df4a6f818248098ecc9ff68f384917, user_id=aa2f31167a54472793ac29a2e5658d97, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.366227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.378632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1118/2226] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:06 2021] PUT /identity/v3/projects/64df4a6f818248098ecc9ff68f384917/users/aa2f31167a54472793ac29a2e5658d97/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:06.389709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.390119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.390476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.420289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] MFA Rules not processed for user `aa2f31167a54472793ac29a2e5658d97`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:06.421529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.491156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1109/2227] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:06.501537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.503223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.557979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592c7d-8c0b-44e1-ab96-c9ff2f8be8af admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.561625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.562252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.562533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.562839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.571378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.572973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ce57-6814-4b66-a1e6-aea28d78ef13 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.582926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1119/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:06 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:06.606725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.666241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acb8ed-6401-49d3-ad11-b9786ee12cf3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.670846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.671691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.671970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.672242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] PATH_INFO: `/v3/users/aa2f31167a54472793ac29a2e5658d97` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.673464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2f31167a54472793ac29a2e5658d97)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.675360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.724381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2f31167a54472793ac29a2e5658d97'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:06.739492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2f31167a54472793ac29a2e5658d97'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:06.747956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2f31167a54472793ac29a2e5658d97'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:06.749188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2f31167a54472793ac29a2e5658d97'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:06.749808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2f31167a54472793ac29a2e5658d97'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:06.763258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1110/2229] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:06 2021] DELETE /identity/v3/users/aa2f31167a54472793ac29a2e5658d97 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:06.768349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.768639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.768917 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.786051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:06.787291 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.841145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1120/2230] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:06.851212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:06.852578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:06.905871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc025e-fe82-4ab8-8eab-33b1c55e6182 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:06.909505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:06.910133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:06.910409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:06.910716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:06.919432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:06.920867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edc99b-2252-459b-9e08-51f5864bff56 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:06.929944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1111/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:07.187157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.188642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:07.208994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c993-a429-4ebf-9482-77e346b4a53b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.213833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.214711 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.214994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.215267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] PATH_INFO: `/v3/projects/64df4a6f818248098ecc9ff68f384917` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.216457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64df4a6f818248098ecc9ff68f384917)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.218347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.262299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64df4a6f818248098ecc9ff68f384917', 'request_id': 'req-6b6a691d-4b6a-46c7-ae8d-f15746222828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:07.267574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64df4a6f818248098ecc9ff68f384917', 'request_id': 'req-6b6a691d-4b6a-46c7-ae8d-f15746222828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:07.275371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64df4a6f818248098ecc9ff68f384917', 'request_id': 'req-6b6a691d-4b6a-46c7-ae8d-f15746222828'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:07.285803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] The token cache is being invalidate because project 64df4a6f818248098ecc9ff68f384917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:07.286086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:07.286730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6b6a691d-4b6a-46c7-ae8d-f15746222828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:07.288208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1121/2232] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:07 2021] DELETE /identity/v3/projects/64df4a6f818248098ecc9ff68f384917 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:07.293971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.294475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.294603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.312379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:07.313561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:07.368876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1112/2233] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:07.376804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703a34-47de-41a2-a169-34866f1234ea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.377260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703a34-47de-41a2-a169-34866f1234ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.377395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703a34-47de-41a2-a169-34866f1234ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.395067 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-df703a34-47de-41a2-a169-34866f1234ea None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:07.396258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-df703a34-47de-41a2-a169-34866f1234ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:07.404011 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1122/2234] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:07.408512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.418087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201fd7-2f3b-4fa9-8ea9-42d93fbf815c None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.423226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.423867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.424146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.424419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.425149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:07.425453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.427059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.438176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1113/2235] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:50:07.442308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df703a34-47de-41a2-a169-34866f1234ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.451338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df703a34-47de-41a2-a169-34866f1234ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.456028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.456666 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.456950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.457223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.457925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.459867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.484739 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1123/2236] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:07 2021] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:07.488997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.499321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a390b-287d-4e8e-8418-48ab87d55282 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.553477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.554136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.554418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.554734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.555432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.557358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.576844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1114/2237] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:07 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:07.580997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.590920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428eb75-1c54-4865-80d3-326953ef39d3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.596045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.596694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.596974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.597251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.597985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.599601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.611177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1124/2238] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:07.614964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.624946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487096-b4a9-4411-bbdd-90ded7a9501a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.629383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.630024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.630307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.630608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.631447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.633406 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2d6ed-87e8-4392-b0c8-c46960082cbc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.642991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1115/2239] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:07.646836 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.656784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232e85-d183-40ca-9d00-3fc8c59e606d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.661345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.662201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.662473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.662772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] PATH_INFO: `/v3/projects/540d4bbd880f404bb915863e8198b86d/users/e6e9fec68827403db58e96ee29187cf8/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.677037 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=540d4bbd880f404bb915863e8198b86d, user_id=e6e9fec68827403db58e96ee29187cf8, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.679654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.691694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1125/2240] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:07 2021] PUT /identity/v3/projects/540d4bbd880f404bb915863e8198b86d/users/e6e9fec68827403db58e96ee29187cf8/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:07.702396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.702396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.702609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.728739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] MFA Rules not processed for user `e6e9fec68827403db58e96ee29187cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:07.729949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:07.791289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1116/2241] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:07 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:07.801761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:07.803560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:07.857016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14d49e-4f99-47f1-8b59-f4c717c938dc admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:07.860644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:07.861264 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:07.861542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:07.861814 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:07.869783 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:07.871233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:07.879997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1126/2242] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:07 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:10.290044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:10.291481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:10.303428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea014-347c-43f8-8cea-cd761129e7b3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:10.306936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:10.307562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:10.307838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:10.308107 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:10.309799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:10.370378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:10.371835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:10.381755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1117/2243] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:10 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:11.387411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:11.388920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:11.455442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98dc19-fe98-4c2b-b84b-176257dd12e7 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:11.459930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:11.460788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:11.461070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:11.461346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] PATH_INFO: `/v3/users/a89417ea7c7442289745cb1851eccaa4` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:11.462677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89417ea7c7442289745cb1851eccaa4)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:11.464571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:11.510135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89417ea7c7442289745cb1851eccaa4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.517738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89417ea7c7442289745cb1851eccaa4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.525443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89417ea7c7442289745cb1851eccaa4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.538044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89417ea7c7442289745cb1851eccaa4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.538693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6073128f-c5c4-457e-8b08-95e99ac8895a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89417ea7c7442289745cb1851eccaa4'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.544661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1127/2244] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:11 2021] DELETE /identity/v3/users/a89417ea7c7442289745cb1851eccaa4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:11.715007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:11.729963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e920cb-3c65-4797-b299-25f4948cd0b6 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:11.785864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:11.786726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:11.787007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:11.787278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] PATH_INFO: `/v3/projects/3a9d946d10724a739e45769fb83f2a7b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:11.788518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9d946d10724a739e45769fb83f2a7b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:11.790336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:11.833248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9d946d10724a739e45769fb83f2a7b', 'request_id': 'req-03158905-6bd2-4626-9f1b-33f21253c470'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.838243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9d946d10724a739e45769fb83f2a7b', 'request_id': 'req-03158905-6bd2-4626-9f1b-33f21253c470'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.844487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9d946d10724a739e45769fb83f2a7b', 'request_id': 'req-03158905-6bd2-4626-9f1b-33f21253c470'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.855444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] The token cache is being invalidate because project 3a9d946d10724a739e45769fb83f2a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:11.855724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.856335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-03158905-6bd2-4626-9f1b-33f21253c470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:11.857869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1118/2245] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:11 2021] DELETE /identity/v3/projects/3a9d946d10724a739e45769fb83f2a7b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:11.863543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:11.863827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:11.864100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:11.882505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:11.883738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:11.947585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1128/2246] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:11.956020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:11.956304 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:11.956579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:11.975289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:11.976673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:11.986740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1119/2247] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:11.990147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.000299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7703-862a-43ba-9262-c7c5ffb08e61 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.004884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.005528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.005808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.006083 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.006845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:12.007151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.008728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.020280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1129/2248] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:50:12.024512 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.033756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de329-cb3c-4a39-b39b-a64cb434f309 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.038296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.039016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.039240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.039511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.040209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.042056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.066254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1120/2249] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:12 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:12.070212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.080454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c51fc-087a-4fa2-9c90-884345ab3dd6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.132958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.133610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.133897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.134241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.134900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.136840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.162752 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1130/2250] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:12 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:12.166857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.176812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd6f2c-640e-440e-a530-99280e6c6c0e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.181719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.182367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.182688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.182963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.183700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.185268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.195748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1121/2251] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:12.199702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.210144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cce71-a78d-4ed5-b593-36c95c3fb584 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.214709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.215346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.215626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.215896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.216619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.218192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619f7c-28a3-46f2-8791-f6d9973b076b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.227534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1131/2252] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:12 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:50:12.232594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.242812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ec75c-c0d9-4155-a694-4d84b1355b65 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.247337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.248209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.249272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.249538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] PATH_INFO: `/v3/projects/18aa7b91368f449aa8fd27f217e60ca3/users/30352ce7b3194b329b259884cac90903/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.263174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aa7b91368f449aa8fd27f217e60ca3, user_id=30352ce7b3194b329b259884cac90903, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.265755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.277796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1122/2253] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:12 2021] PUT /identity/v3/projects/18aa7b91368f449aa8fd27f217e60ca3/users/30352ce7b3194b329b259884cac90903/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:12.288429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.288713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.288988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.315009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] MFA Rules not processed for user `30352ce7b3194b329b259884cac90903`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:12.316189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:12.378429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1132/2254] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:12 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:12.390314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.392057 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:12.490167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3afec3-4649-4daf-b0cf-28aaa1cdb6f6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.495675 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.496308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.496583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.496853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.505383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.506995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc6a1-d3cf-46c3-8779-31333136ffdb service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.515454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1123/2255] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:12.690052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.749497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bde09-fb71-4504-8b67-7a9ef64463c5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.754008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.754901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.755182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.755453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] PATH_INFO: `/v3/users/30352ce7b3194b329b259884cac90903` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.756637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30352ce7b3194b329b259884cac90903)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.758524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:12.801431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30352ce7b3194b329b259884cac90903'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:12.808207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30352ce7b3194b329b259884cac90903'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:12.814675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30352ce7b3194b329b259884cac90903'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:12.825691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30352ce7b3194b329b259884cac90903'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:12.826254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30352ce7b3194b329b259884cac90903'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:12.832409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1133/2256] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:12 2021] DELETE /identity/v3/users/30352ce7b3194b329b259884cac90903 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:12.836915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.837409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.837526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.855073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:12.856253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:12.910592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1124/2257] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:12.920839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:12.922200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:12.977761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d86cf-28db-40ab-83bb-355ff7af100a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:12.980315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:12.980963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:12.981245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:12.981521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:12.993766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:12.994768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adc90a-16a5-4bb5-b2d3-f24ca065ece8 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.006006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1134/2258] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:50:13.267585 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.269081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:13.280931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7a84-4ab8-4f3b-ab39-eaa730066b5f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.285458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.286299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.286602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.286874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] PATH_INFO: `/v3/projects/18aa7b91368f449aa8fd27f217e60ca3` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.291337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18aa7b91368f449aa8fd27f217e60ca3)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.293225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.339135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18aa7b91368f449aa8fd27f217e60ca3', 'request_id': 'req-d7e4a68e-b83a-490d-afbf-f5985a4b364b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:13.344838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18aa7b91368f449aa8fd27f217e60ca3', 'request_id': 'req-d7e4a68e-b83a-490d-afbf-f5985a4b364b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:13.350754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18aa7b91368f449aa8fd27f217e60ca3', 'request_id': 'req-d7e4a68e-b83a-490d-afbf-f5985a4b364b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:13.362966 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] The token cache is being invalidate because project 18aa7b91368f449aa8fd27f217e60ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:13.363248 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:13.363860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7e4a68e-b83a-490d-afbf-f5985a4b364b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:13.365354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1125/2259] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:13 2021] DELETE /identity/v3/projects/18aa7b91368f449aa8fd27f217e60ca3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:13.372463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.372763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.373041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.390718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:13.391913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:13.448592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1135/2260] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:13.455974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.456258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.456531 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.474439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:13.475640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:13.483855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1126/2261] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:50:13.487722 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.497013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cd406-b76e-47fc-b279-1cdedf913572 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.501778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.502428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.502737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.503010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.503734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:13.504034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.505590 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.516410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1136/2262] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:50:13.520268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.529036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58191abb-447e-40f1-ac85-2d411bbe8a61 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.534087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.534748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.535026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.535295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.535989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.537855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.562575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1127/2263] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:13.566496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.576862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b043e93-7df4-48bb-8b1d-8c06ef292b91 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.629377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.629941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.630221 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.630497 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.631240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.633212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.653128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1137/2264] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:13.658644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.668604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80885-65ae-4209-8a7d-fc30ac9f853a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.673978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.674669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.674953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.675229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.676024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.677608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.687605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1128/2265] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:13.691193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.700715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3ed93-d178-4e0b-8dd9-2e9b536e7780 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.705335 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.705968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.706256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.706529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.707286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.708848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5747-544a-49df-a2ed-37d198eb706e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.718816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1138/2266] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:13.722689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.732192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb8b-1cd9-44fc-be14-c11042c90ad3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.737637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.738506 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.738846 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.739121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] PATH_INFO: `/v3/projects/1f70390e0d7840379cc1a4706bbfba57/users/b7bdd54d29cb444fa1629aa48df9f259/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.753995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f70390e0d7840379cc1a4706bbfba57, user_id=b7bdd54d29cb444fa1629aa48df9f259, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.756653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.770245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1129/2267] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:13 2021] PUT /identity/v3/projects/1f70390e0d7840379cc1a4706bbfba57/users/b7bdd54d29cb444fa1629aa48df9f259/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:50:13.781123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.781404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.781673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.809229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] MFA Rules not processed for user `b7bdd54d29cb444fa1629aa48df9f259`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:13.810450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:13.871304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1139/2268] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:50:13.876047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.935530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61807ac-a752-4e2c-8f7e-223b092e3fd2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:13.940044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:13.940688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:13.940968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:13.941242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:13.941945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:13.943861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:13.968684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1130/2269] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:13.972688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:13.983272 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23406f98-d5f1-4b54-b8e1-7d1088d6b8d8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.036963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.037713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.038234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.038474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.039502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.041377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.063895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1140/2270] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:13 2021] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:14.065446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.076082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094a37-db1d-443e-8572-c4ae18fc9fb6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.081227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.081876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.082158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.082428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.083211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.084784 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.094848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1131/2271] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:14.098733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.108289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ca15b-d7b6-42a0-9629-830e1288f72c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.112879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.113737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.114022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.114295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] PATH_INFO: `/v3/projects/adb3302b0a614b99b8f35f6d378b4285/users/2585401488ef45e8a8e29a20ef4c53c7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.130730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb3302b0a614b99b8f35f6d378b4285, user_id=2585401488ef45e8a8e29a20ef4c53c7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.133684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.150485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1141/2272] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:14 2021] PUT /identity/v3/projects/adb3302b0a614b99b8f35f6d378b4285/users/2585401488ef45e8a8e29a20ef4c53c7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:14.154752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.165041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31924c0-212a-4b3b-8fe8-371dcec0e4bf admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.219656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.220230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.220499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.220770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.221500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.223127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6faf0e-15b7-4ae4-9dc7-a7825556df59 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.236134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1132/2273] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:14 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:14.240500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.251050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c129709-5118-49d4-a0cf-2fb39c10dfaf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.255699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.256559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.256839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.257113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] PATH_INFO: `/v3/projects/adb3302b0a614b99b8f35f6d378b4285/users/2585401488ef45e8a8e29a20ef4c53c7/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.259146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb3302b0a614b99b8f35f6d378b4285, user_id=2585401488ef45e8a8e29a20ef4c53c7, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.261761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.272718 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1142/2274] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:14 2021] PUT /identity/v3/projects/adb3302b0a614b99b8f35f6d378b4285/users/2585401488ef45e8a8e29a20ef4c53c7/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:14.283849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.284138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.284411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.309558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] MFA Rules not processed for user `2585401488ef45e8a8e29a20ef4c53c7`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:14.311274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:14.374234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1133/2275] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:14 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:14.384479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.386173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:14.440712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199e53e-837c-4b53-841e-1b60563c60f6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.444417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.445062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.445341 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.445616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.454760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.456183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.465279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1143/2276] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:14 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:14.507576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:14.508952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:14.521159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d277c0-a974-4671-b060-929bb5ad0150 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:14.524975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:14.525604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:14.525880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:14.526147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:14.581106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:14.582572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d0ab8-46c3-45c4-bbc2-299294b13dfd service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:14.591142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1134/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:14 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:17.737080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:17.796571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b19f8-7c9d-4ba9-9ed0-66ce54a8f73a service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:17.801002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:17.801837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:17.802110 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:17.802377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] PATH_INFO: `/v3/users/b7bdd54d29cb444fa1629aa48df9f259` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:17.803573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7bdd54d29cb444fa1629aa48df9f259)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:17.805458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:17.849071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bdd54d29cb444fa1629aa48df9f259'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:17.857240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bdd54d29cb444fa1629aa48df9f259'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:17.864602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bdd54d29cb444fa1629aa48df9f259'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:17.875903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bdd54d29cb444fa1629aa48df9f259'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:17.876529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bdd54d29cb444fa1629aa48df9f259'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:17.882201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1144/2278] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:17 2021] DELETE /identity/v3/users/b7bdd54d29cb444fa1629aa48df9f259 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:17.886609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:17.887066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:17.887290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:17.903843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:17.905543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:17.960161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1135/2279] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:17.970478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:17.971891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:18.025995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbf496-a35c-4182-8ae1-48f972ed3ac2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:18.029659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:18.030822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:18.031103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:18.031377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:18.040054 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:18.041468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:18.051833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1145/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:18.305792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:18.307321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:18.319975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ed1dc-2ba4-400e-aec2-9e544f438c65 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:18.324648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:18.327260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:18.327602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:18.327921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] PATH_INFO: `/v3/projects/1f70390e0d7840379cc1a4706bbfba57` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:18.329347 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f70390e0d7840379cc1a4706bbfba57)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:18.331249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:18.379859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f70390e0d7840379cc1a4706bbfba57', 'request_id': 'req-4c548be5-d5bb-42b6-999d-2700bb61d5d9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.385273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f70390e0d7840379cc1a4706bbfba57', 'request_id': 'req-4c548be5-d5bb-42b6-999d-2700bb61d5d9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.391721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f70390e0d7840379cc1a4706bbfba57', 'request_id': 'req-4c548be5-d5bb-42b6-999d-2700bb61d5d9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.403105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] The token cache is being invalidate because project 1f70390e0d7840379cc1a4706bbfba57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:18.403388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.403994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.406054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1136/2281] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:18 2021] DELETE /identity/v3/projects/1f70390e0d7840379cc1a4706bbfba57 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:18.409988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:18.419308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e052-436a-40e0-85c0-efbeddecec76 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:18.478617 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:18.479470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:18.479745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:18.480017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] PATH_INFO: `/v3/users/2585401488ef45e8a8e29a20ef4c53c7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:18.481216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2585401488ef45e8a8e29a20ef4c53c7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:18.483148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:18.532427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2585401488ef45e8a8e29a20ef4c53c7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.539494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2585401488ef45e8a8e29a20ef4c53c7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.546032 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2585401488ef45e8a8e29a20ef4c53c7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.557075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2585401488ef45e8a8e29a20ef4c53c7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.557648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-3eb6e18a-c167-499e-bd82-837d6e8c6393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2585401488ef45e8a8e29a20ef4c53c7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.563747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1146/2282] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:18 2021] DELETE /identity/v3/users/2585401488ef45e8a8e29a20ef4c53c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:18.819017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:18.820470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:18.833960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548be5-d5bb-42b6-999d-2700bb61d5d9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:18.901850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:18.902763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:18.903074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:18.903345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] PATH_INFO: `/v3/projects/adb3302b0a614b99b8f35f6d378b4285` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:18.904808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb3302b0a614b99b8f35f6d378b4285)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:18.906850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:18.950040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb3302b0a614b99b8f35f6d378b4285', 'request_id': 'req-d1ca45f1-3f65-4c83-a092-af3f71a7f731'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.955971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb3302b0a614b99b8f35f6d378b4285', 'request_id': 'req-d1ca45f1-3f65-4c83-a092-af3f71a7f731'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.961769 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb3302b0a614b99b8f35f6d378b4285', 'request_id': 'req-d1ca45f1-3f65-4c83-a092-af3f71a7f731'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.973160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] The token cache is being invalidate because project adb3302b0a614b99b8f35f6d378b4285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:18.973444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.974127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d1ca45f1-3f65-4c83-a092-af3f71a7f731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:18.975737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1137/2283] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:18 2021] DELETE /identity/v3/projects/adb3302b0a614b99b8f35f6d378b4285 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:18.981523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:18.981994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:18.982111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.001491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:19.002804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:19.067397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1147/2284] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:50:19.075725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.076039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.076320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.094077 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:19.095301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:19.103510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1138/2285] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:19.107621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.118143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adf0ae-1dc4-44d0-a3a9-5cc9e459751f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.122762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.124230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.124536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.124809 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.125544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:50:19.125950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.127732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.139394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1148/2286] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:50:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:50:19.143723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.154321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a8475-7a90-47ad-81f8-ae9a7259c836 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.159936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.160574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.160849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.161120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.161821 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.163897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.192681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1139/2287] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:19 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:19.196782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.206282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fd692-aaa3-46e8-9cb6-bc7072e4cdce admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.259156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.259830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.260103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.260369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.261068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.262971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.282325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1149/2288] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:19 2021] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:19.286104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.296451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4c8e9-1f5b-4703-9584-add270932be9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.300989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.301634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.301912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.302183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.302957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.304530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.315786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1140/2289] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:19.319705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.330206 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d09e2a-6707-4fc4-ba80-9395ab92bf20 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.334778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.335412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.335688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.335958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.336677 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.338229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2903e5b-ccb3-4201-9869-2613a4cb2558 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.348501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1150/2290] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:50:19.352661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.363031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1205-d18b-429d-8b50-df8502057296 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.367664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.368528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.368802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.369071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] PATH_INFO: `/v3/projects/7d0b51f58caf4ea7b9205df9bfb34a78/users/651de8e7a7d84690b9db5e51201e54ed/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.383618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0b51f58caf4ea7b9205df9bfb34a78, user_id=651de8e7a7d84690b9db5e51201e54ed, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.386237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.399252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1141/2291] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:19 2021] PUT /identity/v3/projects/7d0b51f58caf4ea7b9205df9bfb34a78/users/651de8e7a7d84690b9db5e51201e54ed/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:19.404142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbae2-0059-4993-8e3b-1ac4c524cf91 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.404454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbae2-0059-4993-8e3b-1ac4c524cf91 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.404768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbae2-0059-4993-8e3b-1ac4c524cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.423367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-801cbae2-0059-4993-8e3b-1ac4c524cf91 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:19.424630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-801cbae2-0059-4993-8e3b-1ac4c524cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:19.483461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1151/2292] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:19.493337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:19.495044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:19.550091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6e96-0290-43db-a251-25755002ad2b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:19.553708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:19.554318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:19.554621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:19.554896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:19.564243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:19.565663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:19.575412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1142/2293] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:20.369423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.370160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.370160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.405295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] MFA Rules not processed for user `651de8e7a7d84690b9db5e51201e54ed`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:20.406988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:20.470130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1152/2294] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:20 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:20.475168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.489181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aaa87-15f8-48a0-bc7d-5bbf5b40bc4e service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.495494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.496509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.496992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.497471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.499331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.501255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.528335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1143/2295] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:50:20 2021] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:50:20.532772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.543200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194112-cdd0-4004-855f-0e5388eef32b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.600703 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.601379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.601663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.601941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.602690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.604593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.625091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1153/2296] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:50:20 2021] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:50:20.629049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.638993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013d46-9fda-4dff-979a-094f0b847b97 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.643955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.644601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.644881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.645150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.645884 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.647491 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.657959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1144/2297] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:20.661903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.672071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62794ce-951e-467d-b846-2c20d5e652f3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.676723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.677577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.677856 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.678128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] PATH_INFO: `/v3/projects/503940ee90804ca68cbc987367db1635/users/639a7c6d8e3b4df79897bcee8d61c272/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.693744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503940ee90804ca68cbc987367db1635, user_id=639a7c6d8e3b4df79897bcee8d61c272, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.696417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.709367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1154/2298] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:20 2021] PUT /identity/v3/projects/503940ee90804ca68cbc987367db1635/users/639a7c6d8e3b4df79897bcee8d61c272/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:20.713160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.722743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c700-d294-4841-aace-799c4745f0c3 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.777200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.777858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.778138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.778413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.779177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.780777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc1220-d2a6-42c2-99ca-d5f719c2f6e9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.790035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1145/2299] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:50:20 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:50:20.794132 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:20.804479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7f2b9-3191-4fbc-bc50-b1f9397ec406 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:20.809070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:20.809982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:20.810262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:20.810534 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] PATH_INFO: `/v3/projects/503940ee90804ca68cbc987367db1635/users/639a7c6d8e3b4df79897bcee8d61c272/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:20.812587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503940ee90804ca68cbc987367db1635, user_id=639a7c6d8e3b4df79897bcee8d61c272, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:20.815241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:20.825623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1155/2300] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:50:20 2021] PUT /identity/v3/projects/503940ee90804ca68cbc987367db1635/users/639a7c6d8e3b4df79897bcee8d61c272/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:21.417062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:21.417421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:21.417774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:21.452104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] MFA Rules not processed for user `639a7c6d8e3b4df79897bcee8d61c272`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:21.453483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:21.518969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1146/2301] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:21 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:21.529133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:21.530949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:21.587177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb9f46-6018-4d28-98e1-242558e75685 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:21.590800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:21.591445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:21.591726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:21.592001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:21.652161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:21.653594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:21.662769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1156/2302] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:21 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:27.174123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:27.175727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:27.188534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1fa76-c97f-493f-8c13-83934dab7709 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:27.192540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:27.193045 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:27.193390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:27.193666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:27.204619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:27.206243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81225d8-72d8-4a67-80cf-ea13601b1406 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:27.216852 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1147/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:27 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:32.488294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:32.489680 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:32.549501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb6ba-f053-4dee-b66b-1adf3fd1d482 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:32.553953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:32.554828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:32.555156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:32.555429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] PATH_INFO: `/v3/users/e6e9fec68827403db58e96ee29187cf8` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:32.556596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e9fec68827403db58e96ee29187cf8)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:32.558481 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:32.607995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e9fec68827403db58e96ee29187cf8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:32.618771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e9fec68827403db58e96ee29187cf8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:32.631931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e9fec68827403db58e96ee29187cf8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:32.649418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e9fec68827403db58e96ee29187cf8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:32.649418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e9fec68827403db58e96ee29187cf8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:32.657771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1157/2304] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:32 2021] DELETE /identity/v3/users/e6e9fec68827403db58e96ee29187cf8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:32.668528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:32.669448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:32.669730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:32.689779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:32.691041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:32.763936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1148/2305] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:32.776097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:32.777774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:32.840730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4af986-3ca8-486f-a775-3702a8e1702c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:32.846251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:32.846819 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:32.847098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:32.847368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:32.857568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:32.859692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4761a-0f44-4df0-9ae7-592c39345bd1 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:32.871016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1158/2306] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:50:33.349854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:33.351888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:33.366193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b51b70-8ab9-4454-a85c-cdc790a485cf None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:33.381737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:33.383008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:33.383466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:33.383743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] PATH_INFO: `/v3/projects/540d4bbd880f404bb915863e8198b86d` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:33.385031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540d4bbd880f404bb915863e8198b86d)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:33.387037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:33.432422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540d4bbd880f404bb915863e8198b86d', 'request_id': 'req-c6bc298d-b2ad-4835-b426-7be270baa811'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:33.437697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540d4bbd880f404bb915863e8198b86d', 'request_id': 'req-c6bc298d-b2ad-4835-b426-7be270baa811'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:33.443744 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540d4bbd880f404bb915863e8198b86d', 'request_id': 'req-c6bc298d-b2ad-4835-b426-7be270baa811'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:33.457759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] The token cache is being invalidate because project 540d4bbd880f404bb915863e8198b86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:50:33.458160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:33.458826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:33.460348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1149/2307] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:50:33 2021] DELETE /identity/v3/projects/540d4bbd880f404bb915863e8198b86d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:58.335679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1fd1-f194-4c23-9687-481c41c23003 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:58.336197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1fd1-f194-4c23-9687-481c41c23003 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:58.336295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1fd1-f194-4c23-9687-481c41c23003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:58.353016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-466f1fd1-f194-4c23-9687-481c41c23003 None None] MFA Rules not processed for user `768c02d17606458ea666252be580802c`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:58.354194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-466f1fd1-f194-4c23-9687-481c41c23003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:58.406096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1159/2308] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:58 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:59.523815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:59.525226 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:59.593142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc298d-b2ad-4835-b426-7be270baa811 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:59.598360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:59.599254 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:59.599532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:59.599802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] PATH_INFO: `/v3/users/a4a329bdf6c845fb8849936c221eec75` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:59.600995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a329bdf6c845fb8849936c221eec75)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:59.602986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:59.648860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a329bdf6c845fb8849936c221eec75'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:59.661568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a329bdf6c845fb8849936c221eec75'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:59.668465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a329bdf6c845fb8849936c221eec75'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:59.669158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a329bdf6c845fb8849936c221eec75'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:59.669764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a329bdf6c845fb8849936c221eec75'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:50:59.683548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1150/2309] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:50:59 2021] DELETE /identity/v3/users/a4a329bdf6c845fb8849936c221eec75 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:50:59.688735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:59.689214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:59.689313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:59.707164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:50:59.708358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:59.767437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1160/2310] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:50:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:50:59.777291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:50:59.778993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:50:59.840424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b51b-37ad-4592-9d8f-778b96577c4f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:50:59.844172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:50:59.848026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:50:59.848026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:50:59.848026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:50:59.858678 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:50:59.860156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:50:59.870507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1151/2311] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:50:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:00.316518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:00.317964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:00.330265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781823c7-5ab1-4750-b88d-a97fc1a6fe38 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:00.335518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:00.336614 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:00.336897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:00.337347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] PATH_INFO: `/v3/projects/fd305a83d0834d8b9933846fea63c93b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:00.345478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd305a83d0834d8b9933846fea63c93b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:00.347807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:00.397927 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd305a83d0834d8b9933846fea63c93b', 'request_id': 'req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.407541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd305a83d0834d8b9933846fea63c93b', 'request_id': 'req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.416462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd305a83d0834d8b9933846fea63c93b', 'request_id': 'req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.431527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] The token cache is being invalidate because project fd305a83d0834d8b9933846fea63c93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:00.431801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.432541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.434515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1161/2312] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:00 2021] DELETE /identity/v3/projects/fd305a83d0834d8b9933846fea63c93b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:00.439574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:00.450143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38d02-9243-41d5-9a3e-34cfabe35309 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:00.511683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:00.512548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:00.512830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:00.513106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] PATH_INFO: `/v3/users/12a5494d1853448f946813a232062bea` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:00.515520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a5494d1853448f946813a232062bea)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:00.517859 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:00.564962 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a5494d1853448f946813a232062bea'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.578339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a5494d1853448f946813a232062bea'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.589472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a5494d1853448f946813a232062bea'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.590236 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a5494d1853448f946813a232062bea'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.590847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-00829990-88f6-4388-859a-0bd194da17b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a5494d1853448f946813a232062bea'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:00.606401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1152/2313] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:00 2021] DELETE /identity/v3/users/12a5494d1853448f946813a232062bea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:00.884329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:00.885872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:00.901165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288dec-1b90-4a9c-84eb-0a3bc8e04249 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:00.963761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:00.964616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:00.964897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:00.965174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] PATH_INFO: `/v3/projects/77d2f6367db84116901fcd56febc7914` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:00.966377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d2f6367db84116901fcd56febc7914)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:00.968844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.015626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d2f6367db84116901fcd56febc7914', 'request_id': 'req-77308fef-57b4-4113-a017-f12dd030148a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:01.020705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d2f6367db84116901fcd56febc7914', 'request_id': 'req-77308fef-57b4-4113-a017-f12dd030148a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:01.027274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d2f6367db84116901fcd56febc7914', 'request_id': 'req-77308fef-57b4-4113-a017-f12dd030148a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:01.038816 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] The token cache is being invalidate because project 77d2f6367db84116901fcd56febc7914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:01.039108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:01.039795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-77308fef-57b4-4113-a017-f12dd030148a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:01.041757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1162/2314] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:00 2021] DELETE /identity/v3/projects/77d2f6367db84116901fcd56febc7914 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:01.047770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.048141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.048502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.067181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:01.068500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:01.129408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1153/2315] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:01.137445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.137727 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.138003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.157684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:01.159012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:01.167344 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1163/2316] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:01.172431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.183005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872d52-5521-42b5-8c61-ce3c5dcdbee1 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.188352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.189035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.189319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.189599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.190355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:01.190847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.192627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.205920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1154/2317] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:51:01.210197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.219504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505658b-df38-4d2c-8a61-9abc7b1dc792 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.224198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.224854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.225135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.225409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.226129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.228075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.256440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1164/2318] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:01.260517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.270290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4496e84-03f7-4a6d-8e47-62e1b4cd977c admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.328119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.328825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.329117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.329393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.330322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.333008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.356791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1155/2319] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:01.358122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.371882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bef3-68f6-4561-978f-2adfcc972e85 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.377766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.378474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.378806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.379207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.379961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.381566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.397162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1165/2320] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:01.399330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.409817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff7c8-9ec4-4901-b22c-59b28523bfc4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.414776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.418645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.418645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.418645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.418645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.418645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0106-4677-4882-bb31-e688f420f65b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.430002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1156/2321] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:01.434080 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.444667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707833-3feb-4389-a404-f88dc9ba2874 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.450021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.450945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.451934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.452201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] PATH_INFO: `/v3/projects/53ebc3065fe24324b6c649353d31677a/users/442605a8bf924afba48c5399c75ff810/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.469153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ebc3065fe24324b6c649353d31677a, user_id=442605a8bf924afba48c5399c75ff810, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.472540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.488790 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1166/2322] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:01 2021] PUT /identity/v3/projects/53ebc3065fe24324b6c649353d31677a/users/442605a8bf924afba48c5399c75ff810/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:01.500972 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.501086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.501314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.533346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] MFA Rules not processed for user `442605a8bf924afba48c5399c75ff810`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:01.534586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:01.629417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1157/2323] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:01.633779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.713477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc714-deea-402c-a77e-c0403b5a1e6b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.718991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.719719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.719922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.720194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.720897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.722818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.751650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1167/2324] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:01.755641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.766695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ce4bf-79ae-4ec6-be8d-e38abd0b98bc None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.822332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.823053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.823332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.823608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.824318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.827001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.854444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1158/2325] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:01 2021] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:01.855606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.865762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677ae89-20de-46be-a784-d7e4ed5bf211 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.871551 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.872615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.873681 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.873957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.874723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.876321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.888453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1168/2326] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:01.892809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.902942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0921e-1754-4453-a312-94f2d934adf5 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:01.908536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:01.909638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:01.910059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:01.910496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] PATH_INFO: `/v3/projects/0e9337d9d6d049fbb7a27510475fd542/users/ca11fc071a1540b08cf369239e38b237/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:01.928270 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9337d9d6d049fbb7a27510475fd542, user_id=ca11fc071a1540b08cf369239e38b237, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:01.931090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:01.950945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1159/2327] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:01 2021] PUT /identity/v3/projects/0e9337d9d6d049fbb7a27510475fd542/users/ca11fc071a1540b08cf369239e38b237/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:01.952774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:01.965728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431785d9-2f16-4dc9-ad7e-03c4bd7d43de admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.025214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.025883 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.026167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.026443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.027218 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.028808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddf000-c0c8-4811-919e-a43e2c169a70 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.038415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1169/2328] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:02.042684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.052811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c61a83-6ea4-4b25-9921-6929b6f2dc13 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.058104 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.059019 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.059294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.059593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] PATH_INFO: `/v3/projects/0e9337d9d6d049fbb7a27510475fd542/users/ca11fc071a1540b08cf369239e38b237/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.062131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9337d9d6d049fbb7a27510475fd542, user_id=ca11fc071a1540b08cf369239e38b237, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.064807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.075060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1160/2329] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:02 2021] PUT /identity/v3/projects/0e9337d9d6d049fbb7a27510475fd542/users/ca11fc071a1540b08cf369239e38b237/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:02.086762 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.087095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.087387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.114346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] MFA Rules not processed for user `ca11fc071a1540b08cf369239e38b237`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:02.115613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:02.181492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1170/2330] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:02 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:02.193523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.195385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:02.254983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079026-8fb8-4d1c-a8a7-9192690f30af admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.258883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.259558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.259860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.260156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.269430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.270929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.280071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1161/2331] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:02 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:02.592445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.601651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5ad23-fb33-4a48-ad55-5da579d6a0e5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.606489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11fc071a1540b08cf369239e38b237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9337d9d6d049fbb7a27510475fd542', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.607189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.607473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.608410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.609156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:02.609462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.611240 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.626832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1171/2332] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:51:02.628447 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.639139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143bd1-861f-492d-9bbc-5cbcd864d82c service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.644300 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11fc071a1540b08cf369239e38b237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9337d9d6d049fbb7a27510475fd542', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.644975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.645255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.645528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.646222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.648465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.686394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1162/2333] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:02 2021] POST /identity/v3/projects => generated 354 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:02.690942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.703303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d448a9-9561-4883-87d6-17d3b6af8b80 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.761708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11fc071a1540b08cf369239e38b237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9337d9d6d049fbb7a27510475fd542', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.762467 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.762672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.762934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.763671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:02.764006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.765570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.781116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1172/2334] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:51:02.820326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:02.832564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e016cc-77c5-4dc8-b73b-1999f1d91427 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:02.840040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca11fc071a1540b08cf369239e38b237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9337d9d6d049fbb7a27510475fd542', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:02.841095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:02.841375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:02.841698 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] PATH_INFO: `/v3/projects/d767182cbf164b618e0df52e6c0bdc43` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:02.843638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d767182cbf164b618e0df52e6c0bdc43)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:02.845750 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:02.900025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd767182cbf164b618e0df52e6c0bdc43', 'request_id': 'req-edec5e7e-038a-4f05-a5ff-aeb0f2787200'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:02.910774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd767182cbf164b618e0df52e6c0bdc43', 'request_id': 'req-edec5e7e-038a-4f05-a5ff-aeb0f2787200'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:02.921047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd767182cbf164b618e0df52e6c0bdc43', 'request_id': 'req-edec5e7e-038a-4f05-a5ff-aeb0f2787200'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:02.939742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] The token cache is being invalidate because project d767182cbf164b618e0df52e6c0bdc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:02.940532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:02.941601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-edec5e7e-038a-4f05-a5ff-aeb0f2787200 tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:02.943601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1163/2335] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:02 2021] DELETE /identity/v3/projects/d767182cbf164b618e0df52e6c0bdc43 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:03.167990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:03.170126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:03.282082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa8f3-680d-4ed6-aa06-7fbf089f605b tempest-VolumeQuotaClassesTest-1352784103 tempest-VolumeQuotaClassesTest-1352784103-project-admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:03.344763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:03.345990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:03.346347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:03.346653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] PATH_INFO: `/v3/users/442605a8bf924afba48c5399c75ff810` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:03.348002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442605a8bf924afba48c5399c75ff810)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:03.349934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:03.394284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442605a8bf924afba48c5399c75ff810'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:03.401383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442605a8bf924afba48c5399c75ff810'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:03.408662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442605a8bf924afba48c5399c75ff810'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:03.419934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442605a8bf924afba48c5399c75ff810'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:03.420669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442605a8bf924afba48c5399c75ff810'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:03.429492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1173/2336] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:03 2021] DELETE /identity/v3/users/442605a8bf924afba48c5399c75ff810 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:03.431527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:03.432007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:03.432292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:03.450320 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:03.452244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:03.513646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1164/2337] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:03.523559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:03.524948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:03.581146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95fc02-bfcb-4838-b476-b3bb162fa901 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:03.584846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:03.585498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:03.585781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:03.586061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:03.595565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:03.596973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:03.606563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1174/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:04.086438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:04.087982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:04.100128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9ce5-b996-4b11-b048-2ac856112c0a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:04.104733 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397aef1-670e-479c-a512-1533784517be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:04.105504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397aef1-670e-479c-a512-1533784517be admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:04.105778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397aef1-670e-479c-a512-1533784517be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:04.106047 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397aef1-670e-479c-a512-1533784517be admin admin] PATH_INFO: `/v3/projects/53ebc3065fe24324b6c649353d31677a` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:04.107278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397aef1-670e-479c-a512-1533784517be admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ebc3065fe24324b6c649353d31677a)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:04.109733 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397aef1-670e-479c-a512-1533784517be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:04.153011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ebc3065fe24324b6c649353d31677a', 'request_id': 'req-8397aef1-670e-479c-a512-1533784517be'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.158662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ebc3065fe24324b6c649353d31677a', 'request_id': 'req-8397aef1-670e-479c-a512-1533784517be'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.164729 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ebc3065fe24324b6c649353d31677a', 'request_id': 'req-8397aef1-670e-479c-a512-1533784517be'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.177375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] The token cache is being invalidate because project 53ebc3065fe24324b6c649353d31677a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:04.177650 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.178263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.180017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1165/2339] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:04 2021] DELETE /identity/v3/projects/53ebc3065fe24324b6c649353d31677a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:04.184041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:04.193956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60e730-6cd8-49da-a841-9c702919d6fe service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:04.249188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:04.250036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:04.250320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:04.250618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] PATH_INFO: `/v3/users/ca11fc071a1540b08cf369239e38b237` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:04.251832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca11fc071a1540b08cf369239e38b237)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:04.253726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:04.297757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca11fc071a1540b08cf369239e38b237'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.304746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca11fc071a1540b08cf369239e38b237'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.311873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca11fc071a1540b08cf369239e38b237'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.325697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca11fc071a1540b08cf369239e38b237'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.326924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-816a1f25-edc2-401f-90ef-da34ab409fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca11fc071a1540b08cf369239e38b237'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.334102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1175/2340] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:04 2021] DELETE /identity/v3/users/ca11fc071a1540b08cf369239e38b237 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:04.765608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:04.767234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:04.781055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397aef1-670e-479c-a512-1533784517be admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:04.842161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:04.843065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:04.843343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:04.843617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] PATH_INFO: `/v3/projects/0e9337d9d6d049fbb7a27510475fd542` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:04.844888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9337d9d6d049fbb7a27510475fd542)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:04.847440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:04.911060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9337d9d6d049fbb7a27510475fd542', 'request_id': 'req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.917088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9337d9d6d049fbb7a27510475fd542', 'request_id': 'req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.923122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9337d9d6d049fbb7a27510475fd542', 'request_id': 'req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.936208 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] The token cache is being invalidate because project 0e9337d9d6d049fbb7a27510475fd542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:04.936490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.937098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c97f6d-f61e-42bd-9bd5-2cc75dd221da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:04.938669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1166/2341] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:04 2021] DELETE /identity/v3/projects/0e9337d9d6d049fbb7a27510475fd542 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:04.944222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:04.944736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:04.945017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:04.963786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:04.964997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.028213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1176/2342] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:05.035810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.036081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.036355 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.054483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:05.055708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.064477 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1167/2343] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:05.068690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.079525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fc298-f4a9-43a5-b638-abc801d6a9c1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.085652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.091317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.091626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.091946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.092768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:05.093087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.094866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.108974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1177/2344] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:51:05.113216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.122209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2ccf-e978-4e65-8ad1-d5d41a7a3852 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.128190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.128863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.129253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.129527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.130225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.132166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.157657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1168/2345] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:05 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:05.161901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.172411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6f09-24d4-4cf7-8c1c-e64e3e560bc9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.229180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.229853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.230139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.230414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.231166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.233134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.253346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1178/2346] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:05 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:05.258573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.268870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e16e5-5f51-4eea-8061-0e00c26993f8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.274246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.275175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.275560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.275937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.276787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.278476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.289660 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1169/2347] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:05.293779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.305126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581b84-14b5-4b19-8167-98b21e8e50e5 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.310532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.311331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.311610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.311886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.312625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.314393 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefea7d-fdbc-4bf5-9070-a446a2f01257 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.332113 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1179/2348] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:05 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:05.333551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.344593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4239-fb4c-4bfc-a71e-514968776052 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.356161 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.359548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.359548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.359548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] PATH_INFO: `/v3/projects/b506b67c218c47308213dac1494048da/users/eff3199e2e084c21bc271476e2b4fbd9/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.372452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b506b67c218c47308213dac1494048da, user_id=eff3199e2e084c21bc271476e2b4fbd9, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.375426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.388527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1170/2349] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:05 2021] PUT /identity/v3/projects/b506b67c218c47308213dac1494048da/users/eff3199e2e084c21bc271476e2b4fbd9/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:05.399256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.399629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.399911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.426496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] MFA Rules not processed for user `eff3199e2e084c21bc271476e2b4fbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:05.427671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.490137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1180/2350] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:05 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:05.501172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.503081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.558198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea84d7-84e6-4f20-a565-9af4f6eff5c6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.562363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.563027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.563312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.563578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.572334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.573183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.584358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1171/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:05 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:05.602949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.642940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.644502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.669838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84cd77-8ac4-4706-a26f-49d8e1f60acb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.676048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.677072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.677297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.677572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] PATH_INFO: `/v3/users/eff3199e2e084c21bc271476e2b4fbd9` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.678898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff3199e2e084c21bc271476e2b4fbd9)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.680817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.716774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adbe22-4b7b-486c-962a-d2a937a5c3a4 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.722179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.723094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.723376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.723653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] PATH_INFO: `/v3/users/651de8e7a7d84690b9db5e51201e54ed` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.724984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=651de8e7a7d84690b9db5e51201e54ed)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:05.727283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:05.732128 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff3199e2e084c21bc271476e2b4fbd9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.740656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff3199e2e084c21bc271476e2b4fbd9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.748772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff3199e2e084c21bc271476e2b4fbd9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.766530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff3199e2e084c21bc271476e2b4fbd9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.767274 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-91b64da1-e6f0-42f8-af7a-fc38e11b1e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff3199e2e084c21bc271476e2b4fbd9'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.773604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1181/2352] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:05 2021] DELETE /identity/v3/users/eff3199e2e084c21bc271476e2b4fbd9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:05.775192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651de8e7a7d84690b9db5e51201e54ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.778329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.778635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.778913 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:05.788685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651de8e7a7d84690b9db5e51201e54ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.796800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651de8e7a7d84690b9db5e51201e54ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.797768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651de8e7a7d84690b9db5e51201e54ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.798418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651de8e7a7d84690b9db5e51201e54ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:05.804844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:05.806190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.815964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1172/2353] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:05 2021] DELETE /identity/v3/users/651de8e7a7d84690b9db5e51201e54ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:05.863613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1182/2354] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:05.873566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:05.875085 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:05.949989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8098f-0999-4d64-aabb-7d600a858c7d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:05.957293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:05.958011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:05.958532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:05.959069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.058162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.060127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.063558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.067573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.075915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e0223-6480-490a-93e6-4f741a4d5666 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.082073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.083708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.084227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.084609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] PATH_INFO: `/v3/projects/7d0b51f58caf4ea7b9205df9bfb34a78` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.085943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0b51f58caf4ea7b9205df9bfb34a78)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.088705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.092572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1173/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:06.142916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0b51f58caf4ea7b9205df9bfb34a78', 'request_id': 'req-83b4f503-539e-4202-a2b3-6106842566d2'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.148865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0b51f58caf4ea7b9205df9bfb34a78', 'request_id': 'req-83b4f503-539e-4202-a2b3-6106842566d2'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.160086 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0b51f58caf4ea7b9205df9bfb34a78', 'request_id': 'req-83b4f503-539e-4202-a2b3-6106842566d2'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.180524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] The token cache is being invalidate because project 7d0b51f58caf4ea7b9205df9bfb34a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:06.181901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.182721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.187933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1183/2356] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:06 2021] DELETE /identity/v3/projects/7d0b51f58caf4ea7b9205df9bfb34a78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:06.189419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.222806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae345-9d32-4c17-87d1-7d42402f2bde service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.318716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.320586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.321122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.322027 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] PATH_INFO: `/v3/users/639a7c6d8e3b4df79897bcee8d61c272` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.323910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=639a7c6d8e3b4df79897bcee8d61c272)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.327134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.410979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639a7c6d8e3b4df79897bcee8d61c272'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.429611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639a7c6d8e3b4df79897bcee8d61c272'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.443120 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639a7c6d8e3b4df79897bcee8d61c272'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.447329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639a7c6d8e3b4df79897bcee8d61c272'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.448746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639a7c6d8e3b4df79897bcee8d61c272'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.480815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1174/2357] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:06 2021] DELETE /identity/v3/users/639a7c6d8e3b4df79897bcee8d61c272 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:06.603378 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.605584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.620038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4f503-539e-4202-a2b3-6106842566d2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.680353 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.681224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.681495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.681765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] PATH_INFO: `/v3/projects/b506b67c218c47308213dac1494048da` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.682970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b506b67c218c47308213dac1494048da)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.684847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.696946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.698904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.717924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2291e8-c97b-4aff-9bab-f58de5200dcd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.734319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b506b67c218c47308213dac1494048da', 'request_id': 'req-bb1566b1-8394-42c0-bec5-5998e74f20f1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.739586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b506b67c218c47308213dac1494048da', 'request_id': 'req-bb1566b1-8394-42c0-bec5-5998e74f20f1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.747102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b506b67c218c47308213dac1494048da', 'request_id': 'req-bb1566b1-8394-42c0-bec5-5998e74f20f1'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.761018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] The token cache is being invalidate because project b506b67c218c47308213dac1494048da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:06.761305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.761951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-bb1566b1-8394-42c0-bec5-5998e74f20f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.763862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1184/2358] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:06 2021] DELETE /identity/v3/projects/b506b67c218c47308213dac1494048da => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:06.769072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbcdd-65bc-4252-8cb7-829b2da07de6 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.769421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbcdd-65bc-4252-8cb7-829b2da07de6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.769720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbcdd-65bc-4252-8cb7-829b2da07de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.782390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.783957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.784092 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.784363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] PATH_INFO: `/v3/projects/503940ee90804ca68cbc987367db1635` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.785754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=503940ee90804ca68cbc987367db1635)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.787657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.790401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-43edbcdd-65bc-4252-8cb7-829b2da07de6 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:06.791997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-43edbcdd-65bc-4252-8cb7-829b2da07de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.802976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1185/2359] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:06.813319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.813823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.814300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.838025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:06.839267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.839979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503940ee90804ca68cbc987367db1635', 'request_id': 'req-ac3074d0-5448-4f89-85a8-56d11faf09ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.845708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503940ee90804ca68cbc987367db1635', 'request_id': 'req-ac3074d0-5448-4f89-85a8-56d11faf09ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.852261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503940ee90804ca68cbc987367db1635', 'request_id': 'req-ac3074d0-5448-4f89-85a8-56d11faf09ed'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.868706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] The token cache is being invalidate because project 503940ee90804ca68cbc987367db1635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:06.868958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.869615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ac3074d0-5448-4f89-85a8-56d11faf09ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:06.871508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1175/2360] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:06 2021] DELETE /identity/v3/projects/503940ee90804ca68cbc987367db1635 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:06.878295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d954-db0d-4c0c-bcb0-772a73981401 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.878638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d954-db0d-4c0c-bcb0-772a73981401 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.878887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d954-db0d-4c0c-bcb0-772a73981401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.897297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6b92d954-db0d-4c0c-bcb0-772a73981401 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:06.898485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6b92d954-db0d-4c0c-bcb0-772a73981401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.900813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1186/2361] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:06.904929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.906598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1176/2362] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:06.913991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c4d7-003d-43dd-8620-0e5482f1e33c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.914155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.914312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.914616 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.919009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.919652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.920494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.920769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.921507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:06.921815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.923498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.932617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:06.933801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:06.939781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1187/2363] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:51:06.940729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.942533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1177/2364] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:06.946277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.950694 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ec79-71ba-4665-bf89-4c37cd949a3b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.954812 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b201af4-55ea-463c-a84c-a7b327de96f2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.955254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.955882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.956166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.956837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.957574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.959509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:06.959653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.960202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:06.960484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:06.960756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:06.961483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:06.961790 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:06.963398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:06.978430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1178/2365] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 18:51:06.979545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:06.989518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1188/2366] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:06.989932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05150607-0671-40ea-ad52-82296b1c38ef admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:06.995092 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.043403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.044048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.044327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.044593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.045854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.047758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.055233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3421-1ac5-4f12-bf11-058f3531fdba admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.059905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.060591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.060869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.061143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.061841 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.063817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.071695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1179/2367] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:07.076315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.082552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1189/2368] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:06 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:07.086605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.096839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46884e08-6fbb-4e0e-b38c-cbc774482dbd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.134187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da20-9b00-4d23-9c66-fd797a31bfb4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.139533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.140186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.140463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.140727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.141419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.143346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.152565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.153281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.153596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.153947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.154919 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.156700 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.164418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1180/2369] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:07.168182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.169915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1190/2370] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:07.170750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.177909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dde4d3-807e-4f38-8885-3d7df80f5633 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.180198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28398f7-aef6-4699-9b55-86a02bd510a9 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.182359 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.183082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.183390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.183655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.184384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.185200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.186321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.186463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.186644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.186923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.187641 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.189220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.196135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1181/2371] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:07.199440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1191/2372] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:07.200389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.203950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.210601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f021-5daf-4c4d-ac5b-5d2ffc07e2b9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.213225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4c94c-3b41-4b62-b50a-6d7c813d93ca admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.215529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.216196 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.216522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.216828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.217560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.217975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.218879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.219163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.219259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.219439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] PATH_INFO: `/v3/projects/21b98f27e4df474e9a5429b0bd488235/users/415236a0150043b894edbc27796b9be3/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.228803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1182/2373] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:51:07.233102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.233993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b98f27e4df474e9a5429b0bd488235, user_id=415236a0150043b894edbc27796b9be3, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.236721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50d7c-3cb6-43fe-bcae-5d72fe51b81a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.243119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a9e0-8857-4b6c-af19-54916d410b33 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.249731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1192/2374] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:07 2021] PUT /identity/v3/projects/21b98f27e4df474e9a5429b0bd488235/users/415236a0150043b894edbc27796b9be3/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:07.254600 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.254873 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.255169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.272026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:07.273235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:07.296888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.297768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.298040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.298388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] PATH_INFO: `/v3/projects/cf2967c051df4c2e98e37f83a9b01e15/users/714a8e017b624cfbaf12324221fe6df9/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.312575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2967c051df4c2e98e37f83a9b01e15, user_id=714a8e017b624cfbaf12324221fe6df9, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.315240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bde784-2892-4163-a363-998ad6e9ec45 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.330010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1183/2375] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:07 2021] PUT /identity/v3/projects/cf2967c051df4c2e98e37f83a9b01e15/users/714a8e017b624cfbaf12324221fe6df9/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:07.332376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1193/2376] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:07.341157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.341448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.341725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.341834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.343164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:07.367562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] MFA Rules not processed for user `714a8e017b624cfbaf12324221fe6df9`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:07.368758 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:07.398048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee3a8-3f1f-4377-9e47-d800db6d0171 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.432911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1184/2377] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:07.438031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.445251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.445890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.446166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.446437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.498901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fd761-6a23-4e34-bec3-eca84198fca5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.504071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.504850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.505238 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.505619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.506444 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.507823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.509380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.509760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.519101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1194/2378] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:51:07.538578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1185/2379] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:07.540229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.550713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a9038-126d-46c2-b6fd-9004e56276ec service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.608251 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.609316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.609503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.610106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.610673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.612577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.637430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1195/2380] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:07.638867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.649296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957f088-25be-4d7a-bb3f-cb579eb5add6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.654804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.655466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.655748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.656038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.656760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.658384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.671039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1186/2381] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:07.675068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.686247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2e290-dd4e-4704-bb81-260c7af56933 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.691213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.692199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.692475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.692749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] PATH_INFO: `/v3/projects/332c7b2b1a3f442480fe62c40eb314ad/users/cac10a44296b4cb183097115fad73c25/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.707745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332c7b2b1a3f442480fe62c40eb314ad, user_id=cac10a44296b4cb183097115fad73c25, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.710387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.728068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1196/2382] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:07 2021] PUT /identity/v3/projects/332c7b2b1a3f442480fe62c40eb314ad/users/cac10a44296b4cb183097115fad73c25/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:07.729325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.741042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277545b-53c1-4908-9bdf-5d4937648297 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.808869 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.809537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.809822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.810096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.810908 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.812520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269907-22ef-4c96-994c-ead33f47b7f0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.822068 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1187/2383] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:07.826311 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.836635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103986e4-93c5-45f0-97cf-e9149b8e1901 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:07.842217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:07.843143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.843424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.843701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] PATH_INFO: `/v3/projects/332c7b2b1a3f442480fe62c40eb314ad/users/cac10a44296b4cb183097115fad73c25/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.845801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332c7b2b1a3f442480fe62c40eb314ad, user_id=cac10a44296b4cb183097115fad73c25, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:07.848529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:07.860433 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1197/2384] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:07 2021] PUT /identity/v3/projects/332c7b2b1a3f442480fe62c40eb314ad/users/cac10a44296b4cb183097115fad73c25/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:07.870495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4f66-076c-4df0-9f63-73aa0c0353c5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:07.870817 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4f66-076c-4df0-9f63-73aa0c0353c5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:07.871093 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4f66-076c-4df0-9f63-73aa0c0353c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:07.898928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-217d4f66-076c-4df0-9f63-73aa0c0353c5 None None] MFA Rules not processed for user `cac10a44296b4cb183097115fad73c25`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:07.900156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-217d4f66-076c-4df0-9f63-73aa0c0353c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:07.970922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1188/2385] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:07 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:07.986493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:07.988616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:08.051338 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2798f9-7263-4d10-959b-81032ab6fec3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:08.055159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:08.055803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:08.056278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:08.056407 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:08.114740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:08.116257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:08.126756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1198/2386] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:07 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:51:08.248501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba64a0-b695-4593-8b9f-4a6bc8b1d957 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:08.249003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba64a0-b695-4593-8b9f-4a6bc8b1d957 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:08.249143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba64a0-b695-4593-8b9f-4a6bc8b1d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:08.280841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-acba64a0-b695-4593-8b9f-4a6bc8b1d957 None None] MFA Rules not processed for user `415236a0150043b894edbc27796b9be3`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:08.282436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-acba64a0-b695-4593-8b9f-4a6bc8b1d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:08.362743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1189/2387] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:08 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:08.372527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:08.393547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc4ce-a1b9-4458-8959-7c04123197de service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:08.397943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:08.398811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:08.398992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:08.399516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:08.409821 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:08.411503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:08.421640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1199/2388] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:09.812751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:09.813263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:09.813364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:09.831328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] MFA Rules not processed for user `415236a0150043b894edbc27796b9be3`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:09.832249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:09.841178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1190/2389] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:12.382805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:12.391906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe602-ffc9-4749-8d0a-db38afaacc74 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:12.395554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:12.396186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:12.396468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:12.396750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:12.405651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:12.407147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf028f0-908c-469f-a91f-97d5151ae964 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:12.417189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1200/2390] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:12 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:17.246128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:17.304443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e1f77-741f-4714-b4b8-c6c1a8d60b16 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:17.308850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:17.309687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:17.309960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:17.310227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] PATH_INFO: `/v3/users/714a8e017b624cfbaf12324221fe6df9` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:17.312058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714a8e017b624cfbaf12324221fe6df9)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:17.313945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:17.356138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714a8e017b624cfbaf12324221fe6df9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.367601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714a8e017b624cfbaf12324221fe6df9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.374721 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714a8e017b624cfbaf12324221fe6df9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.375356 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714a8e017b624cfbaf12324221fe6df9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.376021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714a8e017b624cfbaf12324221fe6df9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.387350 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1191/2391] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:17 2021] DELETE /identity/v3/users/714a8e017b624cfbaf12324221fe6df9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:17.391868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:17.392354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:17.392449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:17.409282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:17.410476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:17.466162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1201/2392] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:17.476364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:17.477749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:17.532522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc638f-f93f-4c31-a6b7-025d7e4e3dd6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:17.536086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:17.536726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:17.537005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:17.537274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:17.547717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:17.549140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:17.558452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1192/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:17.896941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:17.898517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:17.912972 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f6a88-1d91-4901-99a3-4f9f05a14401 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:17.917839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:17.918769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:17.919057 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:17.919332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] PATH_INFO: `/v3/projects/cf2967c051df4c2e98e37f83a9b01e15` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:17.920591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2967c051df4c2e98e37f83a9b01e15)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:17.922486 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:17.969042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2967c051df4c2e98e37f83a9b01e15', 'request_id': 'req-7bb102ed-2cb2-4703-a339-016d2a718b4a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.974391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2967c051df4c2e98e37f83a9b01e15', 'request_id': 'req-7bb102ed-2cb2-4703-a339-016d2a718b4a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.981855 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2967c051df4c2e98e37f83a9b01e15', 'request_id': 'req-7bb102ed-2cb2-4703-a339-016d2a718b4a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.992573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] The token cache is being invalidate because project cf2967c051df4c2e98e37f83a9b01e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:17.993320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.993484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:17.995029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1202/2394] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:17 2021] DELETE /identity/v3/projects/cf2967c051df4c2e98e37f83a9b01e15 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:17.999428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.010774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7fbb-d18e-482a-af87-a0ae238c30e3 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.066283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.067084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.067362 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.067629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] PATH_INFO: `/v3/users/cac10a44296b4cb183097115fad73c25` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.068843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac10a44296b4cb183097115fad73c25)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.070777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.115659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac10a44296b4cb183097115fad73c25'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.127458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac10a44296b4cb183097115fad73c25'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.133970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac10a44296b4cb183097115fad73c25'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.134687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac10a44296b4cb183097115fad73c25'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.135398 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-54fa0ee1-0818-46b1-a44b-5f3df6e540df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac10a44296b4cb183097115fad73c25'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.148838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1193/2395] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:51:17 2021] DELETE /identity/v3/users/cac10a44296b4cb183097115fad73c25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:18.420813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.422333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:18.435802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb102ed-2cb2-4703-a339-016d2a718b4a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.490407 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.491292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.491574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.491848 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] PATH_INFO: `/v3/projects/332c7b2b1a3f442480fe62c40eb314ad` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.493061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332c7b2b1a3f442480fe62c40eb314ad)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.495000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.538064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332c7b2b1a3f442480fe62c40eb314ad', 'request_id': 'req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.543245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332c7b2b1a3f442480fe62c40eb314ad', 'request_id': 'req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.549818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332c7b2b1a3f442480fe62c40eb314ad', 'request_id': 'req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.559922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] The token cache is being invalidate because project 332c7b2b1a3f442480fe62c40eb314ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:51:18.560203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.560819 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ecb82668-a712-4bcd-be0c-5dbbf5a2c048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:51:18.562939 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1203/2396] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:51:18 2021] DELETE /identity/v3/projects/332c7b2b1a3f442480fe62c40eb314ad => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:18.569914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.570380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.570500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.591363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:18.592485 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:18.651164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1194/2397] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:18.659576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.659864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.660140 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.679160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:18.680383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:18.688230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1204/2398] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:18.692596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.702298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a734efb-2b03-4efd-a962-43120d479cff None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.707160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.707814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.708094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.708367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.709136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:51:18.709441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.711063 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.722839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1195/2399] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:51:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:51:18.727258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.736236 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6574-6685-4985-a917-a6499f964cc8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.740860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.741501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.741777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.742048 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.742787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.744743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.773071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1205/2400] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:18 2021] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:18.775536 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.786179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d8110-0ee1-4f41-b6d9-d9ce84c614c4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.844844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.845430 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.845706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.845974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.846703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.848604 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.869798 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1196/2401] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:18 2021] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:51:18.877300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.888595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2ce6-c176-48f4-ac0f-1b44695192ef admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.893653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.894298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.894627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.894899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.895626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.897392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.908148 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1206/2402] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:18.912123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.921746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb596ce-cc9c-4076-8598-c5a3fc8da198 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.926207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.926877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.927152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.927420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.928143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.929710 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47864b78-847c-401a-b375-4fe378906321 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.939617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1197/2403] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:18.943513 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:18.953705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdec1b-fcdd-4dec-af5f-121850650d75 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:18.958285 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:18.959213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.959501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.959774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] PATH_INFO: `/v3/projects/3d9bbc61321a47abb852671e78856939/users/1e832293b7d74dc9bf0ee30104162054/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:18.973904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9bbc61321a47abb852671e78856939, user_id=1e832293b7d74dc9bf0ee30104162054, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:18.976586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:18.990529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1207/2404] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:18 2021] PUT /identity/v3/projects/3d9bbc61321a47abb852671e78856939/users/1e832293b7d74dc9bf0ee30104162054/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:18.995607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:18.995900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:18.996182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:19.015554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:19.016540 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:19.074765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1198/2405] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:19.085607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:19.087910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:19.145451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b210e82-b347-4c0d-8cc7-d85b66f79e9e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:19.149537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:19.150077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:19.150379 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:19.150584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:19.166906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:19.168460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6e756-6680-4a89-bd25-8182d1a2f79a service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:19.178282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1208/2406] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:21.205443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:21.207064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:21.221728 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bf321-906c-4d23-a29e-c65c515881f2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:21.225473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:21.226214 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:21.226568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:21.226932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:21.228828 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:21.304581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:21.306024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:21.318160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1199/2407] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:23.141203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.141725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.141826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.167547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] MFA Rules not processed for user `1e832293b7d74dc9bf0ee30104162054`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:23.168684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:23.232154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1209/2408] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:23 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:23.237142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.247383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d71b4-26ef-42bb-a7a4-acb50d515ff9 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.252434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.253256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.253548 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.253963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.254932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.256601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.292087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1200/2409] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:51:23 2021] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:23.293323 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.303991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2b33-dc70-49f4-a53d-f58cb2f7efe1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.361094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.361766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.362075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.362352 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.363085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.365002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.388689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1210/2410] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:51:23 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:51:23.390850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.401224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834cdc2-f878-47e2-a69d-5262f081a3b9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.407941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.408637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.408917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.409185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.409979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.411625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.422687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1201/2411] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:23.426770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.437607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912abb8-67af-4eb4-be22-76a8776cacae admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.442248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.443161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.443442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.443714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] PATH_INFO: `/v3/projects/05ded8decfef4c8fa900c664ca483ca0/users/cfc7f5a510884d209eee1fb948d6c0bf/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.459693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ded8decfef4c8fa900c664ca483ca0, user_id=cfc7f5a510884d209eee1fb948d6c0bf, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.462377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.476151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1211/2412] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:23 2021] PUT /identity/v3/projects/05ded8decfef4c8fa900c664ca483ca0/users/cfc7f5a510884d209eee1fb948d6c0bf/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:51:23.479804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.489764 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93a22-35a9-40a8-a33f-369c31d606c7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.546818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.547494 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.547772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.548043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.548787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.550371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265817b-4312-495a-ad36-c670aa57a46d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.560597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1202/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:51:23.567914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:23.587882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc1c66-ec82-4e23-8f43-764b46bddad1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:23.594278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:23.595484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:23.595760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:23.596185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] PATH_INFO: `/v3/projects/05ded8decfef4c8fa900c664ca483ca0/users/cfc7f5a510884d209eee1fb948d6c0bf/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:23.598424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ded8decfef4c8fa900c664ca483ca0, user_id=cfc7f5a510884d209eee1fb948d6c0bf, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:23.601276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:23.612741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1212/2414] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:51:23 2021] PUT /identity/v3/projects/05ded8decfef4c8fa900c664ca483ca0/users/cfc7f5a510884d209eee1fb948d6c0bf/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:51:28.160486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be0e7-cb18-46f7-8265-a2008e5ea213 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:28.160887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be0e7-cb18-46f7-8265-a2008e5ea213 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:28.161179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be0e7-cb18-46f7-8265-a2008e5ea213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:28.187188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-203be0e7-cb18-46f7-8265-a2008e5ea213 None None] MFA Rules not processed for user `cfc7f5a510884d209eee1fb948d6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:28.188470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-203be0e7-cb18-46f7-8265-a2008e5ea213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:28.259390 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1203/2415] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:28 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:28.270324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:28.272163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:28.357309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3faab-9546-4a80-b945-a84e51b82ea3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:28.362953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:28.363599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:28.363878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:28.364152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:28.419763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:28.421403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:28.430001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1213/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:28 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:29.963438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabea9c-c0c4-405a-926c-87128b4b3d6b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:29.963980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabea9c-c0c4-405a-926c-87128b4b3d6b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:29.963980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabea9c-c0c4-405a-926c-87128b4b3d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:29.983472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-2aabea9c-c0c4-405a-926c-87128b4b3d6b None None] MFA Rules not processed for user `1e832293b7d74dc9bf0ee30104162054`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:29.984717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2aabea9c-c0c4-405a-926c-87128b4b3d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:29.992007 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1204/2417] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:29 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:32.368198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:32.441858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9f449-8d41-4b2c-b8b6-e3dc2a96f7fb service nova] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:32.446507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:32.447302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:32.447594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:32.448017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:32.449906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:32.466108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:32.467746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:32.479941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1214/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:35.954446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611689-84b2-459d-af7f-bea73d05cee2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:35.954999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611689-84b2-459d-af7f-bea73d05cee2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:35.954999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611689-84b2-459d-af7f-bea73d05cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:35.975500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-44611689-84b2-459d-af7f-bea73d05cee2 None None] MFA Rules not processed for user `415236a0150043b894edbc27796b9be3`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:35.976921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-44611689-84b2-459d-af7f-bea73d05cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:36.039081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1205/2419] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:51:35 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:51:36.277105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:36.286746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290b5c-066a-46d8-9118-fd5aec12beb4 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:36.290701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:36.291412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:36.291882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:36.292167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:36.294186 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:36.305151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:36.306643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0b24c-64b5-42ad-a7bf-e2888858c36d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:36.315265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1215/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:36.668922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb72c5-f021-4ad4-9dbd-a52b994c21af None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:36.669309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb72c5-f021-4ad4-9dbd-a52b994c21af None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:36.669672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb72c5-f021-4ad4-9dbd-a52b994c21af None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:36.672261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1206/2421] 10.222.0.36 () {54 vars in 960 bytes} [Mon Oct 18 18:51:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:51:36.678263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:36.678574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:36.678853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:36.749004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] MFA Rules not processed for user `047a6b4b18904ee08f9c348948c1e795`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:51:36.750141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:36.815429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1216/2422] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Oct 18 18:51:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:51:36.825249 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb72c5-f021-4ad4-9dbd-a52b994c21af None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:36.847601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb72c5-f021-4ad4-9dbd-a52b994c21af None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:36.852544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:36.853179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:36.853460 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:36.853740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:36.855503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:36.867159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:36.868719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:36.879525 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1207/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:36 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:51:51.543596 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:51:51.552510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e3e88-3211-4ce9-b328-99849cf0dbea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:51:51.556088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:51:51.556720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:51:51.557005 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:51:51.557280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:51:51.559044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:51:51.568708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:51:51.570119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eeaf2-21d9-4a46-bd6f-9346806c2e56 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:51:51.580868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1217/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:51:51 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:05.934293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:05.936664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:05.953785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201276-5f46-4fe4-9511-4e7e9457ca26 service placement] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:05.963394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:05.964457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:05.965402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:05.965688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:05.968190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:05.990907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:06.008476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:06.036302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1208/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:07.782172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd25d7-0f3c-4d7d-a495-ddb6d9bacec3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:07.782702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd25d7-0f3c-4d7d-a495-ddb6d9bacec3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:07.782811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd25d7-0f3c-4d7d-a495-ddb6d9bacec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:07.827942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-12cd25d7-0f3c-4d7d-a495-ddb6d9bacec3 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:07.829142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-12cd25d7-0f3c-4d7d-a495-ddb6d9bacec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:07.888452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1218/2426] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:52:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:07.936259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:07.937693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:08.031924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffe6b-e772-4f54-8143-df24d831864b service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:08.036878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:08.037516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:08.037793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:08.038064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:08.045892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:08.047602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:08.055554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1209/2427] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:52:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:52:14.295381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:14.295958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:14.295958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:14.315203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:14.316757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:14.324223 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1219/2428] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:52:14 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:14.340151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:14.355818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b79ab7-f73c-40cd-8122-e11a13def58a service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:14.361998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:14.362724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:14.363017 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:14.363276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:14.376657 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:14.378530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:14.388961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1210/2429] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:52:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 18:52:21.969034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:21.971260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:22.052909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5871f-5fd1-42bf-b583-c1d3f10d008a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:22.058963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:22.060884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:22.061215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:22.061505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] PATH_INFO: `/v3/users/768c02d17606458ea666252be580802c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:22.062969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] RBAC: Authorizing `identity:delete_user(user_id=768c02d17606458ea666252be580802c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:22.065273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:22.126260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768c02d17606458ea666252be580802c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.136087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768c02d17606458ea666252be580802c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.144107 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768c02d17606458ea666252be580802c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.160556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768c02d17606458ea666252be580802c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.161716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768c02d17606458ea666252be580802c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.168922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1220/2430] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:52:21 2021] DELETE /identity/v3/users/768c02d17606458ea666252be580802c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:52:22.395608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:22.396766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:22.398422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:22.416507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeb8bc-c963-46b6-9385-6a40d2721de7 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:22.495864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:22.496436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:22.496971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:22.497256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:22.499268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:22.548814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:22.550689 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:22.562662 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1211/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:22.565214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cdcea-4974-4494-9d86-4d847e97491c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:22.576928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:22.577811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:22.578093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:22.578373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] PATH_INFO: `/v3/projects/55b0b1fbfa48461dbe73523f1557f875` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:22.582139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b0b1fbfa48461dbe73523f1557f875)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:22.587277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:22.657381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b0b1fbfa48461dbe73523f1557f875', 'request_id': 'req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.662999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b0b1fbfa48461dbe73523f1557f875', 'request_id': 'req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.672160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b0b1fbfa48461dbe73523f1557f875', 'request_id': 'req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.684632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] The token cache is being invalidate because project 55b0b1fbfa48461dbe73523f1557f875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:52:22.684999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.685737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-7c3d1ef8-ac6d-4c48-bd14-05b3bc9e2367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:22.687350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1221/2432] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:52:22 2021] DELETE /identity/v3/projects/55b0b1fbfa48461dbe73523f1557f875 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:52:24.864310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:24.866509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:24.952218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6a0bc-b267-4e6f-842e-63632c441944 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:25.020332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:25.020998 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.021280 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.021558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.023384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:25.036800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:25.039098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f97bf5-a724-49b8-8ce5-9706f3bcca00 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:25.048893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1212/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:25.183867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.184487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.184487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.187036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1222/2434] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:52:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:52:25.194526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abc47-e664-4be4-8216-84e47e966e30 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.195162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abc47-e664-4be4-8216-84e47e966e30 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.195715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abc47-e664-4be4-8216-84e47e966e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.253799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-704abc47-e664-4be4-8216-84e47e966e30 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:25.256321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-704abc47-e664-4be4-8216-84e47e966e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:25.351611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1213/2435] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:52:25 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:52:25.365732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:25.369020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:25.505142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e262a-4b16-4961-aeb3-e62e4313d5ee None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:25.509726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:25.510383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.510697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.510975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.525861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:25.527330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb80c-9e17-40de-b0f4-afae904c2ebd service glance] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:25.541142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1223/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:25.639822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.640232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.640637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.643858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1214/2437] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:52:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:52:25.648619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181e29-5e63-478c-905f-c66fe21d6d92 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.648978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181e29-5e63-478c-905f-c66fe21d6d92 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.649324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181e29-5e63-478c-905f-c66fe21d6d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.682796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-83181e29-5e63-478c-905f-c66fe21d6d92 None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:25.684038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-83181e29-5e63-478c-905f-c66fe21d6d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:25.697320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1224/2438] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:52:25 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:52:25.710453 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:25.712281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:25.729599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6b945-8198-44a1-aa9d-5ccd7fd2459e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:25.734098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:25.734856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:25.735141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:25.735442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:25.743520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:25.744961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:25.753772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1215/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:28.537960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e6c-af7f-4892-92cc-303d16f7af6e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:28.538559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e6c-af7f-4892-92cc-303d16f7af6e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:28.538672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c7e6c-af7f-4892-92cc-303d16f7af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:28.560857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-af6c7e6c-af7f-4892-92cc-303d16f7af6e None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:28.562075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-af6c7e6c-af7f-4892-92cc-303d16f7af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:28.630838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1225/2440] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:52:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:28.647895 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:28.650053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:28.725751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4798eb1-79dc-41f6-bd32-ce15d5d1664d service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:28.730894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:28.731671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:28.732502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:28.732779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:28.742037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:28.743806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:28.753377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1216/2441] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:52:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:52:32.578265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:32.578835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:32.578835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:32.601431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:32.603105 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:32.612313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1226/2442] 10.222.0.36 () {58 vars in 967 bytes} [Mon Oct 18 18:52:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:32.627718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:32.639148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e036b-a2dd-4fbc-99bf-ad1a5e5822a6 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:32.655314 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:32.655984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:32.656266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:32.656699 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:32.665941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:32.667868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:32.677119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1217/2443] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:52:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:52:34.776401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:34.778023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:34.843812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279918-9d48-4e5a-9eb6-81f137ab33e3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:34.848277 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:34.849135 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:34.849416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:34.849689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] PATH_INFO: `/v3/users/415236a0150043b894edbc27796b9be3` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:34.850916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415236a0150043b894edbc27796b9be3)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:34.852833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:34.897933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415236a0150043b894edbc27796b9be3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:34.906346 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415236a0150043b894edbc27796b9be3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:34.913474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415236a0150043b894edbc27796b9be3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:34.928003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415236a0150043b894edbc27796b9be3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:34.929134 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b0d9a656-f529-4b6d-be63-59dbdafe5924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415236a0150043b894edbc27796b9be3'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:34.937284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1227/2444] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:52:34 2021] DELETE /identity/v3/users/415236a0150043b894edbc27796b9be3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:52:35.163416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.175898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ec39-8132-46b5-b4b7-96664d749660 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.272431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.273299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.273575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.273843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] PATH_INFO: `/v3/projects/21b98f27e4df474e9a5429b0bd488235` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.275284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b98f27e4df474e9a5429b0bd488235)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.277373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.325026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b98f27e4df474e9a5429b0bd488235', 'request_id': 'req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:35.331953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b98f27e4df474e9a5429b0bd488235', 'request_id': 'req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:35.339183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b98f27e4df474e9a5429b0bd488235', 'request_id': 'req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:35.353545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] The token cache is being invalidate because project 21b98f27e4df474e9a5429b0bd488235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:52:35.353827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:35.354451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d7c28deb-1dfa-42ce-a44d-4a1bb007a257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:52:35.356394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1218/2445] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:52:35 2021] DELETE /identity/v3/projects/21b98f27e4df474e9a5429b0bd488235 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:52:35.363573 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.363892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.364131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.383506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:35.384713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:35.442808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1228/2446] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:52:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:35.451705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.452268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.460619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.480147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:35.481736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:35.491742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1219/2447] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:52:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:35.496108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.507909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291117f-9e2e-4131-b884-7b8bf38b611c None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.512712 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.513434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.513690 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.523041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.523041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:52:35.523041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.523041 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.530586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1229/2448] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:52:35.533175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.542336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dde13-fc95-425a-8c53-a3fe50fe117f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.547558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.548193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.548466 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.548731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.549413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.551310 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.579285 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1220/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:52:35 2021] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:52:35.584004 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.608964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414645d6-6165-413e-a96f-773fbc5f2aeb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.663477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.664144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.664434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.664709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.665410 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.667411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.694294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1230/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:52:35 2021] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:52:35.698409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.709891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b443-977f-4cc8-adf8-9833f2fefd03 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.715021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.715691 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.715973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.716245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.717922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.719611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.731415 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1221/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:52:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:52:35.735945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.745742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d568b4-002f-4a75-bb68-fa82d31bf57e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.750507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.751182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.751457 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.751725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.752451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.754006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8156ea-049c-459e-bcb4-c678a084d1c2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.763691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1231/2452] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:52:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:52:35.767439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.777306 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db66963-35bd-4b12-bf58-ed5bc45ee9dc admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.782410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.783292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.783570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.783840 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] PATH_INFO: `/v3/projects/11eb7dd0e62a4223abebc47a9642f2e0/users/079e0d4b16344f6fa767e7b25b88adf0/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.799638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11eb7dd0e62a4223abebc47a9642f2e0, user_id=079e0d4b16344f6fa767e7b25b88adf0, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:35.802872 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:35.817741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1222/2453] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:52:35 2021] PUT /identity/v3/projects/11eb7dd0e62a4223abebc47a9642f2e0/users/079e0d4b16344f6fa767e7b25b88adf0/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:52:35.828638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.829693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.830249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:35.858770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] MFA Rules not processed for user `079e0d4b16344f6fa767e7b25b88adf0`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:52:35.860088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:35.925267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1232/2454] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:52:35 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:52:35.935555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:35.937433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:35.992125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de142de0-cd9e-4f36-a8a9-431fdcd2bb8f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:35.995910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:35.996487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:35.997026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:35.997296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:36.005886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:36.007384 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:36.017562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1223/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:35 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:52:51.897320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:52:51.898931 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:51.953565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb91464-c637-40b2-8425-74e5369f2767 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:52:51.957071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:52:51.957698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:52:51.957971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:52:51.958241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:52:51.959973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:52:52.019539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:52:52.020954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3f4bc-ace1-4f8c-970e-abc4f2a51036 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:52:52.030657 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1233/2456] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:52:51 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:53:02.531991 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:02.592135 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b945c-1b8e-48e9-902a-33f05f436878 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:02.596623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:02.597472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:02.597748 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:02.598018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] PATH_INFO: `/v3/users/079e0d4b16344f6fa767e7b25b88adf0` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:02.599275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=079e0d4b16344f6fa767e7b25b88adf0)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:02.601182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:02.644621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079e0d4b16344f6fa767e7b25b88adf0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:02.656260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079e0d4b16344f6fa767e7b25b88adf0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:02.662719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079e0d4b16344f6fa767e7b25b88adf0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:02.663389 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079e0d4b16344f6fa767e7b25b88adf0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:02.663994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-56276001-0f26-46b3-8b00-32d39b73e5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079e0d4b16344f6fa767e7b25b88adf0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:02.675976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1224/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:53:02 2021] DELETE /identity/v3/users/079e0d4b16344f6fa767e7b25b88adf0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:53:02.680624 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:02.681076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:02.681205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:02.698090 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:02.699307 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:02.708977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:02.709265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:02.709546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:02.728625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:02.729849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:02.758173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1234/2458] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:02.768262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:02.769540 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:02.785523 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1225/2459] 10.222.0.36 () {58 vars in 967 bytes} [Mon Oct 18 18:53:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:53:02.799185 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:02.800533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:02.824751 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271302e-403f-4470-bc1b-b581114f5347 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:02.828502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:02.829142 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:02.829419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:02.829692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:02.838636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:02.840051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:02.849876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1235/2460] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:53:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:53:02.866586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504651fb-d1be-43d2-bc73-fed11ecacd2d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:02.871562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:02.872200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:02.872478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:02.872749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:02.880712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:02.882279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0128fb-9066-456e-8c7b-6dcfac809acb service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:02.890371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1226/2461] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:53:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 18:53:03.118207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.119893 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:03.134403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1afc5-8b9e-4fb7-85ca-f89cb5243930 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.139643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.140663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.140960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.141237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] PATH_INFO: `/v3/projects/11eb7dd0e62a4223abebc47a9642f2e0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.142667 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11eb7dd0e62a4223abebc47a9642f2e0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.144601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.199111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11eb7dd0e62a4223abebc47a9642f2e0', 'request_id': 'req-1ef5a972-7b30-42ec-a7ad-4e142a02f599'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:03.206517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11eb7dd0e62a4223abebc47a9642f2e0', 'request_id': 'req-1ef5a972-7b30-42ec-a7ad-4e142a02f599'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:03.215787 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11eb7dd0e62a4223abebc47a9642f2e0', 'request_id': 'req-1ef5a972-7b30-42ec-a7ad-4e142a02f599'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:03.228458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] The token cache is being invalidate because project 11eb7dd0e62a4223abebc47a9642f2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:53:03.228811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:03.229501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1ef5a972-7b30-42ec-a7ad-4e142a02f599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:53:03.231324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1236/2462] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:53:03 2021] DELETE /identity/v3/projects/11eb7dd0e62a4223abebc47a9642f2e0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:53:03.238309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d598-5022-4193-8319-69fc1803706e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.238629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d598-5022-4193-8319-69fc1803706e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.238913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d598-5022-4193-8319-69fc1803706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.257740 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a046d598-5022-4193-8319-69fc1803706e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:03.258997 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a046d598-5022-4193-8319-69fc1803706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:03.326782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1227/2463] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:03.328549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410783-2042-4873-a201-8485fa13a2dd None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.328835 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410783-2042-4873-a201-8485fa13a2dd None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.329143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52410783-2042-4873-a201-8485fa13a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.347906 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-52410783-2042-4873-a201-8485fa13a2dd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:03.349111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-52410783-2042-4873-a201-8485fa13a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:03.356984 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1237/2464] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:03.361455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046d598-5022-4193-8319-69fc1803706e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.370930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046d598-5022-4193-8319-69fc1803706e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.376325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.376981 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.377255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.377532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.378273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:53:03.378608 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.380204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.392250 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1228/2465] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:53:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:53:03.396494 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52410783-2042-4873-a201-8485fa13a2dd None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.406632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52410783-2042-4873-a201-8485fa13a2dd None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.412603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.413258 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.413539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.413815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.414518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.416470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.458595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1238/2466] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:53:03 2021] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:53:03.462341 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.473615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44150-a09e-4b18-bdd0-3ab1f88f398d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.528023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.528609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.528906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.529703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.530400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.532417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.551455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1229/2467] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:53:03 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:53:03.555909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.565823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa731-376c-46e4-939f-2e1d0b747718 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.570445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.571552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.572039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.572371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.573645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.575918 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.587156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1239/2468] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:53:03.591426 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.601930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddea3-61ba-4cb0-aa4a-84a92be12652 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.606652 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.607849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.608134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.608411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.609143 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.610765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c1387-dfb3-47ff-b182-aaa1f5def323 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.620431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1230/2469] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:53:03.624884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.637527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a645b-d082-41ae-ad59-f866c44db762 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.642161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.643059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.643342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.643616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] PATH_INFO: `/v3/projects/552f8de0e7db44e2a872923be003d5e6/users/a17c9ab81f9744549afa7a7da56f9577/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.661959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552f8de0e7db44e2a872923be003d5e6, user_id=a17c9ab81f9744549afa7a7da56f9577, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.664747 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.678934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1240/2470] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:53:03 2021] PUT /identity/v3/projects/552f8de0e7db44e2a872923be003d5e6/users/a17c9ab81f9744549afa7a7da56f9577/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:53:03.684050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.684345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.684627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.703235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:03.704570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:03.763197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1231/2471] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:03.774065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:03.775788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:03.831832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2262-16d9-4581-bd6f-d150f4891d03 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:03.835501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:03.836137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:03.836415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:03.836687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:03.846224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:03.847679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25847-7962-4364-8111-700dc2d19900 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:03.857061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1241/2472] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:53:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:53:06.109714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:06.111431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:06.206687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327df4-d10f-45ab-a216-1b7a49ae003e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:06.216035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:06.217814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:06.218298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:06.218827 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:06.220932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:06.295606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:06.297266 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:06.307094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1232/2473] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:53:06 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:53:07.991720 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:07.992136 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:07.992217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.021588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] MFA Rules not processed for user `a17c9ab81f9744549afa7a7da56f9577`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:08.022876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:08.085744 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1242/2474] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:08.090361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.100670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0f8a-d789-40fa-a171-0b1b5bc552a8 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.105809 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.106586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.107146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.107553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.108387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.110455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.138125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1233/2475] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:53:08 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:53:08.142713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.153665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9de6-16b5-4a44-b2ae-6402288fcfa4 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.208078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.208768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.209031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.209304 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.210028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.212003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.235061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1243/2476] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:53:08 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:53:08.236319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.260037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf349-9f86-49d1-8a85-e5b3d198339e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.269000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.269928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.270213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.270493 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.271385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.273278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.285559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1234/2477] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:53:08.289731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.303756 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57517dac-bb73-49f1-8fcd-d50a0e32bd19 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.308593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.309625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.309909 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.310213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] PATH_INFO: `/v3/projects/efb78d3c460e458bb07087de51683eb0/users/9af4b1dd15f64d99b2a06f72d0f199f5/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.326633 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb78d3c460e458bb07087de51683eb0, user_id=9af4b1dd15f64d99b2a06f72d0f199f5, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.329295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.343978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1244/2478] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:53:08 2021] PUT /identity/v3/projects/efb78d3c460e458bb07087de51683eb0/users/9af4b1dd15f64d99b2a06f72d0f199f5/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:53:08.347919 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.358278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575f5eb-6e62-47e3-a1f2-08c2fdcbcfce admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.414181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.414887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.415168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.415437 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.416176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.417836 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05b07f-8142-4095-83f5-87406f606317 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.428323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1235/2479] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:53:08.432413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:08.442865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182b42c-fe07-4b43-91d5-179b325600e8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:08.447725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:08.448612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:08.448888 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:08.449190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] PATH_INFO: `/v3/projects/efb78d3c460e458bb07087de51683eb0/users/9af4b1dd15f64d99b2a06f72d0f199f5/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:08.451729 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb78d3c460e458bb07087de51683eb0, user_id=9af4b1dd15f64d99b2a06f72d0f199f5, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:08.454403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:08.475499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1245/2480] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:53:08 2021] PUT /identity/v3/projects/efb78d3c460e458bb07087de51683eb0/users/9af4b1dd15f64d99b2a06f72d0f199f5/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:53:12.821327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d85d-f4dc-4008-b499-d1cde2bcf5a7 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:12.821941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d85d-f4dc-4008-b499-d1cde2bcf5a7 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:12.821941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d85d-f4dc-4008-b499-d1cde2bcf5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:12.847823 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6e85d85d-f4dc-4008-b499-d1cde2bcf5a7 None None] MFA Rules not processed for user `9af4b1dd15f64d99b2a06f72d0f199f5`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:12.849395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6e85d85d-f4dc-4008-b499-d1cde2bcf5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:12.928253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1236/2481] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:12 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:12.941875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:12.943629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:13.005051 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4c56f-0305-4cd6-8ab8-54bb9e37fdf1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:13.008625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:13.009278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:13.009555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:13.009828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:13.065828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:13.067407 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:13.076637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1246/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:53:12 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:53:13.177953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0bf0-db15-4ff5-b314-6704878faa87 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:13.178241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0bf0-db15-4ff5-b314-6704878faa87 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:13.178599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de0bf0-db15-4ff5-b314-6704878faa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:13.196416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-55de0bf0-db15-4ff5-b314-6704878faa87 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:13.197635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-55de0bf0-db15-4ff5-b314-6704878faa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:13.253880 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1237/2483] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:53:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:13.277806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:13.279838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:13.355926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759adbd-980b-4ebb-9b12-f73069ffaaf6 service glance] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:13.361098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:13.361791 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:13.362035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:13.362296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:13.370860 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:13.373227 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040363a7-ffe3-454b-bd8a-f6714f0541bb service swift] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:13.386866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1247/2484] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:53:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:53:22.682459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:22.682969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:22.683089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:22.700708 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] MFA Rules not processed for user `a17c9ab81f9744549afa7a7da56f9577`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:22.701892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:22.708730 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1238/2485] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:53:22 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:53:24.589584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:24.590174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:24.590174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:24.609010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:53:24.610224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:24.618289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1248/2486] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:53:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:53:24.631535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:24.643475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deecef-2640-423d-824b-81c07df0a653 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:24.649224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:24.650123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:24.650470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:24.650848 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:24.660219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:24.662210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:24.681940 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1239/2487] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:53:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:53:58.723025 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:53:58.724414 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:53:58.777786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644e6c0-7fcd-4938-9813-faea6d30fe9e None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:53:58.781834 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:53:58.782468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:53:58.782778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:53:58.783050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:53:58.791864 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:53:58.793300 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85f32-4877-4199-9eff-03110a97ee1d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:53:58.803013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1249/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:53:58 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:54:11.998336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:54:12.065367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f973-94c2-42b3-ae44-9f16d21ac263 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:54:12.070811 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:54:12.071439 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:54:12.071715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:54:12.072008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:54:12.073752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:12.128327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:54:12.129906 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:54:12.138671 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1240/2489] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:54:11 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:54:19.519160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817be6-540d-4039-b589-807c72258df7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:54:19.519772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817be6-540d-4039-b589-807c72258df7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:54:19.519772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7817be6-540d-4039-b589-807c72258df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:54:19.536765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f7817be6-540d-4039-b589-807c72258df7 None None] MFA Rules not processed for user `a7acad3852514d64be0969ac7bf19221`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:54:19.537953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f7817be6-540d-4039-b589-807c72258df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:19.544766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1250/2490] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:54:19 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:54:30.689780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:54:30.701537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26eac-a34b-416f-ad66-a6de5aa4fd4d service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:54:30.708363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:54:30.709020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:54:30.709305 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:54:30.709670 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:54:30.711482 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:30.725755 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:54:30.727367 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4406f-17c1-4f2c-b368-50126da5ae04 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:54:30.737891 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1241/2491] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:54:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:54:35.618118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7817be6-540d-4039-b589-807c72258df7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:54:35.619628 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f7817be6-540d-4039-b589-807c72258df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:35.694769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7817be6-540d-4039-b589-807c72258df7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:54:35.701421 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:54:35.702076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:54:35.702357 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:54:35.702676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:54:35.704506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:35.716546 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:54:35.717985 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80795525-4da5-41bf-a255-0b1752ee8333 service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:54:35.728364 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1251/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:54:35 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:54:38.901542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:54:38.902040 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:54:38.902142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:54:38.919246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] MFA Rules not processed for user `d6485150f2824de2ae86b24ffd96fb78`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:54:38.920465 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:54:38.972773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1242/2493] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:54:38 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:15.049331 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:15.049878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:15.049878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:15.071266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:15.072451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:15.079475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1252/2494] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:56:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:15.122539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:15.134281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c7009-0482-45f7-a911-73df8f49f3b2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:15.139239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:15.139871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:15.140150 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:15.140425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:15.149037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:15.150344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2072a8f-5952-49da-bc4a-fb6efe42f9ef service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:15.158233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1243/2495] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:56:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:56:21.978878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:21.993637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e5a58-29ef-4e6d-9be8-cebbd554dbc0 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:21.997483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:21.998126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:21.998404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:21.998713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:22.000560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:22.015313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:22.016742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e681d0c-e7d0-458c-9bad-878a5fdc3e54 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:22.028754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1253/2496] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:56:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:56:30.175268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ca4f-93bf-4ac6-b586-8379340e641d None None] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.175922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ca4f-93bf-4ac6-b586-8379340e641d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.175922 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ca4f-93bf-4ac6-b586-8379340e641d None None] PATH_INFO: `/` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.177808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1244/2497] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:56:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:56:30.184077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597e3f-f78c-4c98-a3c4-56687d120156 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.184693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597e3f-f78c-4c98-a3c4-56687d120156 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.184693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597e3f-f78c-4c98-a3c4-56687d120156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.203208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-77597e3f-f78c-4c98-a3c4-56687d120156 None None] MFA Rules not processed for user `55aabb50c4eb46c78cdf468b3044ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:30.204423 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-77597e3f-f78c-4c98-a3c4-56687d120156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:30.214371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1254/2498] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:56:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:56:30.228315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ca4f-93bf-4ac6-b586-8379340e641d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:30.242754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ca4f-93bf-4ac6-b586-8379340e641d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:30.247771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd34f3e4c4a4244128b8d4d1ba548d270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:30.248340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.248614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.248881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.259893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:30.261318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f39b-9a5e-4af0-8c6a-744d43b6c43d service glance] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:30.272297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1245/2499] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:56:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:56:30.339184 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161e63-5d60-4e04-9adf-3f4de3a8b597 None None] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.339470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161e63-5d60-4e04-9adf-3f4de3a8b597 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.339749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161e63-5d60-4e04-9adf-3f4de3a8b597 None None] PATH_INFO: `/` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.341535 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1255/2500] 10.222.0.36 () {54 vars in 921 bytes} [Mon Oct 18 18:56:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 18:56:30.346598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56e78-fc6a-4a41-87c2-52c04287a87e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.346882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56e78-fc6a-4a41-87c2-52c04287a87e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.347151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee56e78-fc6a-4a41-87c2-52c04287a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.382339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-3ee56e78-fc6a-4a41-87c2-52c04287a87e None None] MFA Rules not processed for user `4c9e3e4d7b9d4bf0858c4c2562eb49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:30.384066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3ee56e78-fc6a-4a41-87c2-52c04287a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:30.390386 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1246/2501] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Oct 18 18:56:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:30.402993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161e63-5d60-4e04-9adf-3f4de3a8b597 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:30.413570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161e63-5d60-4e04-9adf-3f4de3a8b597 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:30.417091 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:30.417704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:30.417979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:30.418245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:30.424957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:30.426354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:30.434077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1256/2502] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:56:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:56:32.041332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:32.041806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:32.041905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:32.059458 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:32.060625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:32.067581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1247/2503] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:56:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:32.080637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:32.092866 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b0a9-a4a8-4f9f-8554-64f68ea260ee service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:32.097763 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:32.098381 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:32.098699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:32.098973 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:32.106731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:32.108225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4d12-e8ee-4c67-a7e4-f1d6ce3b9bf6 service swift] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:32.115910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1257/2504] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:56:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:56:32.983175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:33.010719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b6ac-4c56-4bd2-952c-27a8f2442217 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:33.014577 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:33.015233 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:33.015513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:33.015785 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:33.017598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:33.031182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:33.032597 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:33.043175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1248/2505] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:56:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:56:50.953095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa676-724c-4fe9-8435-29126c896b93 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:50.953616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa676-724c-4fe9-8435-29126c896b93 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:50.953725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa676-724c-4fe9-8435-29126c896b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:50.971789 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-424fa676-724c-4fe9-8435-29126c896b93 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:50.973002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-424fa676-724c-4fe9-8435-29126c896b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:50.980159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1258/2506] 10.222.0.36 () {58 vars in 967 bytes} [Mon Oct 18 18:56:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:50.993542 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:51.004627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5264-952f-4421-9e63-3549c1b6fba1 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:51.010206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:51.010868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:51.011149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:51.011429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:51.019202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:51.020770 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:51.028532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1249/2507] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:56:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:56:54.966647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970202-9884-4732-a808-542862b780ef None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:54.967158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970202-9884-4732-a808-542862b780ef None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:54.967281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970202-9884-4732-a808-542862b780ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:54.985201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-1c970202-9884-4732-a808-542862b780ef None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:56:54.986394 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1c970202-9884-4732-a808-542862b780ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:56:54.993475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1259/2508] 10.222.0.36 () {58 vars in 967 bytes} [Mon Oct 18 18:56:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:56:55.006172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:56:55.016425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7ce45-1284-4cc2-b624-3417961018af service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:56:55.021387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:56:55.022010 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:56:55.022290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:56:55.023132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:56:55.030914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:56:55.032473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:56:55.040804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1250/2509] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:56:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:57:02.153465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c970202-9884-4732-a808-542862b780ef None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:02.213571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c970202-9884-4732-a808-542862b780ef None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:02.218020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:02.218918 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:02.219198 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:02.219472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] PATH_INFO: `/v3/users/a17c9ab81f9744549afa7a7da56f9577` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:02.220686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17c9ab81f9744549afa7a7da56f9577)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:02.222627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:02.271016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17c9ab81f9744549afa7a7da56f9577'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.271583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:02.278849 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17c9ab81f9744549afa7a7da56f9577'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.281472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46598-b6f8-487b-b3dc-3adc77508c6e service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:02.285079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:02.285524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17c9ab81f9744549afa7a7da56f9577'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.285705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:02.286035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:02.286257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:02.288061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:02.296827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17c9ab81f9744549afa7a7da56f9577'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.297533 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17c9ab81f9744549afa7a7da56f9577'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.299829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:02.301323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:02.304487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1260/2510] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:02 2021] DELETE /identity/v3/users/a17c9ab81f9744549afa7a7da56f9577 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:02.311964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1251/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:02.476417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:02.478060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:02.548853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ee70-6544-47d7-927f-6379921d7a94 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:02.553630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:02.554480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:02.554803 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:02.555082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] PATH_INFO: `/v3/projects/552f8de0e7db44e2a872923be003d5e6` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:02.556294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552f8de0e7db44e2a872923be003d5e6)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:02.558202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:02.603340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552f8de0e7db44e2a872923be003d5e6', 'request_id': 'req-e9143e83-b9a4-4b39-8692-44d8c5d59a61'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.608428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552f8de0e7db44e2a872923be003d5e6', 'request_id': 'req-e9143e83-b9a4-4b39-8692-44d8c5d59a61'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.616991 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552f8de0e7db44e2a872923be003d5e6', 'request_id': 'req-e9143e83-b9a4-4b39-8692-44d8c5d59a61'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.629156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] The token cache is being invalidate because project 552f8de0e7db44e2a872923be003d5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:02.629443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.630087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.632195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1261/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:02 2021] DELETE /identity/v3/projects/552f8de0e7db44e2a872923be003d5e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:02.636123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:02.645402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7efb-5090-498b-8600-3ee4d8741363 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:02.707043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:02.707913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:02.708188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:02.708457 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] PATH_INFO: `/v3/users/9af4b1dd15f64d99b2a06f72d0f199f5` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:02.710395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af4b1dd15f64d99b2a06f72d0f199f5)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:02.712191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:02.760484 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af4b1dd15f64d99b2a06f72d0f199f5'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.773936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af4b1dd15f64d99b2a06f72d0f199f5'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.781217 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af4b1dd15f64d99b2a06f72d0f199f5'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.782005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af4b1dd15f64d99b2a06f72d0f199f5'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.782697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af4b1dd15f64d99b2a06f72d0f199f5'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:02.796243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1252/2513] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:02 2021] DELETE /identity/v3/users/9af4b1dd15f64d99b2a06f72d0f199f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:02.969081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:02.971081 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:02.991813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9143e83-b9a4-4b39-8692-44d8c5d59a61 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:03.049940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:03.050827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:03.051174 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:03.051519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] PATH_INFO: `/v3/projects/efb78d3c460e458bb07087de51683eb0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:03.052792 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb78d3c460e458bb07087de51683eb0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:03.055326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:03.099582 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb78d3c460e458bb07087de51683eb0', 'request_id': 'req-75349855-c681-4e91-9a9e-9c5a3227202e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:03.104767 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb78d3c460e458bb07087de51683eb0', 'request_id': 'req-75349855-c681-4e91-9a9e-9c5a3227202e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:03.112318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb78d3c460e458bb07087de51683eb0', 'request_id': 'req-75349855-c681-4e91-9a9e-9c5a3227202e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:03.124146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] The token cache is being invalidate because project efb78d3c460e458bb07087de51683eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:03.124442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:03.125039 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:03.126583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1262/2514] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:02 2021] DELETE /identity/v3/projects/efb78d3c460e458bb07087de51683eb0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:05.479552 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:05.480989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:05.494539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357bc4-4bf7-4ca0-ada8-7ea2afffaa0b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:05.549993 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:05.550902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:05.551182 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:05.551455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] PATH_INFO: `/v3/users/d6485150f2824de2ae86b24ffd96fb78` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:05.567413 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6485150f2824de2ae86b24ffd96fb78)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:05.569970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:05.613843 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6485150f2824de2ae86b24ffd96fb78'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.626294 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6485150f2824de2ae86b24ffd96fb78'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.633190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6485150f2824de2ae86b24ffd96fb78'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.633910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6485150f2824de2ae86b24ffd96fb78'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.634509 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3f5ff10f-c334-4d29-ac45-de88455b53ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6485150f2824de2ae86b24ffd96fb78'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.648749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1253/2515] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:05 2021] DELETE /identity/v3/users/d6485150f2824de2ae86b24ffd96fb78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:05.823926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:05.825399 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:05.840122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349855-c681-4e91-9a9e-9c5a3227202e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:05.895139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:05.895904 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:05.896181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:05.896452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] PATH_INFO: `/v3/projects/dc823e02a9644b6fbac6ff4758ce4660` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:05.906974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc823e02a9644b6fbac6ff4758ce4660)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:05.909125 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:05.960369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc823e02a9644b6fbac6ff4758ce4660', 'request_id': 'req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.967805 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc823e02a9644b6fbac6ff4758ce4660', 'request_id': 'req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.976901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc823e02a9644b6fbac6ff4758ce4660', 'request_id': 'req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.994693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] The token cache is being invalidate because project dc823e02a9644b6fbac6ff4758ce4660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:05.994826 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.995753 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c050edd-0ff4-4cf4-9b9f-5ac19acd0c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:05.997830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1263/2516] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:05 2021] DELETE /identity/v3/projects/dc823e02a9644b6fbac6ff4758ce4660 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:06.003807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.004090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.004364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.023130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:06.024319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:06.082916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1254/2517] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:06.090945 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.091235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.091515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.109870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:06.111101 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:06.120704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1264/2518] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:06.125153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.135422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91ba7a-77c9-42e5-9d80-ed90d8d49e27 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.140228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.140967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.141242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.141527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.142239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:06.142563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.144177 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.156136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1255/2519] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:06.160478 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.170356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481302a-070c-4501-b8dd-85e06099a818 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.174992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.175645 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.175921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.176193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.176894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.179458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.206580 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1265/2520] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:06 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:06.210653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.220649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5c50a-dcf8-4164-81ca-4f8f3b778748 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.276980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.277640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.277914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.278181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.278931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.280808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.299732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1256/2521] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:06 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:06.304547 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.314401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7162e4-d762-4a59-9795-06fab4a43dfd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.318970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.320155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.320431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.320698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.321419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.323012 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.335774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1266/2522] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:57:06.339747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.349318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b428ce9-4baa-43ad-b9cd-a0c9242bb443 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.354354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.355026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.355301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.355569 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.356293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.357855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf19bc-f55a-4ace-ac86-aabba04a16d3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.368179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1257/2523] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:06.372432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.382736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711647b-40e0-469c-9107-05bbba3de73d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.387559 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.388430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.388742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.389016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] PATH_INFO: `/v3/projects/5620b237975e4fbdbbe35ae08796fac9/users/9046373ae53e47f38190b9a7efefdf28/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.403571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5620b237975e4fbdbbe35ae08796fac9, user_id=9046373ae53e47f38190b9a7efefdf28, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.406283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.418651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1267/2524] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:06 2021] PUT /identity/v3/projects/5620b237975e4fbdbbe35ae08796fac9/users/9046373ae53e47f38190b9a7efefdf28/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:06.429230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.429524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.429808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.455544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] MFA Rules not processed for user `9046373ae53e47f38190b9a7efefdf28`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:06.456745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:06.517642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1258/2525] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:06.530925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:06.532827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:06.602313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96aeb-3272-415b-9544-3fc803d43a2e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:06.607924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:06.608555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:06.608837 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:06.609115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:06.617852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:06.619701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aa00e-b270-4deb-bb5f-a3bcd845eb4f service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:06.628350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1268/2526] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:06 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:15.862443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:15.921992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450e579-d4fc-4ffe-8339-51ecdf2083c0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:15.926409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:15.927293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:15.927570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:15.927853 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] PATH_INFO: `/v3/users/9046373ae53e47f38190b9a7efefdf28` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:15.929008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9046373ae53e47f38190b9a7efefdf28)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:15.931440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:15.974684 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9046373ae53e47f38190b9a7efefdf28'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:15.985879 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9046373ae53e47f38190b9a7efefdf28'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:15.992839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9046373ae53e47f38190b9a7efefdf28'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:15.994343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9046373ae53e47f38190b9a7efefdf28'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:15.994456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9046373ae53e47f38190b9a7efefdf28'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.006873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1259/2527] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:15 2021] DELETE /identity/v3/users/9046373ae53e47f38190b9a7efefdf28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:16.011938 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.012391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.012502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.029263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:16.030431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:16.087506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1269/2528] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:16.097418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.098819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:16.153100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add6bd-e99c-4a1e-a33a-e36846aa34b4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.156774 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.157399 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.157677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.157949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.167174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.168591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80abc-f81a-44ed-961e-f9a6ee41a5f6 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.177855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1260/2529] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:16.435589 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.437167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:16.449999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dea7-e274-4ef6-85b9-e2b2a748e2d8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.454647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.455525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.455804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.456716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] PATH_INFO: `/v3/projects/5620b237975e4fbdbbe35ae08796fac9` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.458121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5620b237975e4fbdbbe35ae08796fac9)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.460010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.504651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5620b237975e4fbdbbe35ae08796fac9', 'request_id': 'req-2c786630-e0a6-43f5-9a6c-0f9d1c000154'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.509793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5620b237975e4fbdbbe35ae08796fac9', 'request_id': 'req-2c786630-e0a6-43f5-9a6c-0f9d1c000154'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.516228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5620b237975e4fbdbbe35ae08796fac9', 'request_id': 'req-2c786630-e0a6-43f5-9a6c-0f9d1c000154'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.527656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] The token cache is being invalidate because project 5620b237975e4fbdbbe35ae08796fac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:16.527943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.528566 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-2c786630-e0a6-43f5-9a6c-0f9d1c000154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:16.530060 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1270/2530] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:16 2021] DELETE /identity/v3/projects/5620b237975e4fbdbbe35ae08796fac9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:16.535762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.536050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.536328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.556963 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:16.558154 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:16.614685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1261/2531] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:16.624757 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.625065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.625327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.643199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:16.644400 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:16.652749 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1271/2532] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:16.656731 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.666614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f75f3-aee5-4ac2-90f6-e798fdae1779 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.671108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.671743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.672020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.672296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.673022 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:16.673325 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.674928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.688547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1262/2533] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:16.692794 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.707576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ed325-cefc-4da1-9b2b-d60d2054cadb None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.712771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.713418 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.713699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.713976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.714714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.716606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.743745 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1272/2534] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:16.748050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.757864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fd7a-0267-4c04-a267-3faa02a4d52b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.811131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.811786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.812066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.812338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.813023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.815152 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.835296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1263/2535] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:16.840262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.850018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937c58-3500-4733-8e79-ee7b4ff260d0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.854586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.855229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.855505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.855772 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.856500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.858072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.867965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1273/2536] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:16.871948 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.881676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158948-992a-4a9d-8cf8-a860dfef94ca admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.886726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.887361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.887634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.887899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.888618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.890170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc3036-e158-4f67-8dc8-3501bc6188b3 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.900220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1264/2537] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:16.904022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:16.913326 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20c32-daae-4d6f-afa9-da6cc7360b11 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:16.917828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:16.918714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.918992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.919260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] PATH_INFO: `/v3/projects/11bfc7ecf63e4a22b494f7a7f7dd792c/users/84e5ba444de44ced98bdb9e9f788b57b/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.932780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bfc7ecf63e4a22b494f7a7f7dd792c, user_id=84e5ba444de44ced98bdb9e9f788b57b, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:16.935420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:16.947891 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1274/2538] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:16 2021] PUT /identity/v3/projects/11bfc7ecf63e4a22b494f7a7f7dd792c/users/84e5ba444de44ced98bdb9e9f788b57b/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:16.957795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:16.958078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:16.958378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:16.984119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] MFA Rules not processed for user `84e5ba444de44ced98bdb9e9f788b57b`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:16.985302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:17.049179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1265/2539] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:16 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:17.054016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.115898 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677793-ac3c-4806-8533-efc782b47063 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.120957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.121601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.121882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.122156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.122879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.124804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.150077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1275/2540] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:17 2021] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:17.154078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.164529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3836e-1914-4a39-a100-8363a159708b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.216898 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.217544 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.217832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.218095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.218832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.220727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.239656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1266/2541] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:17 2021] POST /identity/v3/users => generated 309 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:17.244398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.254349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b17ce-5a76-4d0e-9f94-15d317055b50 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.259659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.260303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.260586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.260865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.261601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.263231 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.274238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1276/2542] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:17.278105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.287734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232c97e-c451-442d-a241-ae65369316d0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.292419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.293271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.293550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.293819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] PATH_INFO: `/v3/projects/809e690edf354740a5d90c23b8160760/users/100129e4556540b595176e62f1815595/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.308511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=809e690edf354740a5d90c23b8160760, user_id=100129e4556540b595176e62f1815595, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.311206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.324026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1267/2543] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:17 2021] PUT /identity/v3/projects/809e690edf354740a5d90c23b8160760/users/100129e4556540b595176e62f1815595/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:17.327804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.337366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2670d8-80c9-4131-b0a9-96a511ef8aeb admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.393212 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.393781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.394056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.394355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.395119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.396691 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc7a9c-404a-499c-bcff-0cc3bfae3fac admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.406244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1277/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:17 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:17.410407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.420468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c73795-a647-4c14-bc1b-633ebeab0aeb admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.425009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.425861 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.426133 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.426396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] PATH_INFO: `/v3/projects/809e690edf354740a5d90c23b8160760/users/100129e4556540b595176e62f1815595/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.428352 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] RBAC: Authorizing `identity:create_grant(project_id=809e690edf354740a5d90c23b8160760, user_id=100129e4556540b595176e62f1815595, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.431564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.441342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1268/2545] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:17 2021] PUT /identity/v3/projects/809e690edf354740a5d90c23b8160760/users/100129e4556540b595176e62f1815595/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:17.453620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.453901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.454172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.479076 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] MFA Rules not processed for user `100129e4556540b595176e62f1815595`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:17.480257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:17.543043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1278/2546] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:17 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:17.552553 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.554221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:17.607342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f93f7-86c7-42b1-ae07-cf1cce24419a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.610918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.611532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.611808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.612080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.622191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.623617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ed384-b730-43f8-b10e-b82d69b16586 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.632703 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1269/2547] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:17 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:17.755150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.813853 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e668e4f-e375-431b-a030-b80f2af3e3e6 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:17.818355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:17.819234 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.819515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.819788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] PATH_INFO: `/v3/users/84e5ba444de44ced98bdb9e9f788b57b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.820970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e5ba444de44ced98bdb9e9f788b57b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:17.822916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:17.865741 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e5ba444de44ced98bdb9e9f788b57b'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:17.873271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e5ba444de44ced98bdb9e9f788b57b'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:17.879781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e5ba444de44ced98bdb9e9f788b57b'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:17.890740 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e5ba444de44ced98bdb9e9f788b57b'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:17.891367 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e5ba444de44ced98bdb9e9f788b57b'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:17.896925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1279/2548] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:17 2021] DELETE /identity/v3/users/84e5ba444de44ced98bdb9e9f788b57b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:17.901679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:17.902180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:17.902331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:17.919633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:17.920810 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:17.975566 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1270/2549] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:17.985743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:17.987144 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:18.041063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5f07-6528-4ae2-80ff-e274809e96ad admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:18.044725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:18.045356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:18.045636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:18.045910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:18.054648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:18.056059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:18.065102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1280/2550] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:18.321805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:18.323276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:18.338640 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a949c5d-726f-4678-8d67-7d1ff555f96d None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:18.344832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:18.345579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:18.345857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:18.346215 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] PATH_INFO: `/v3/projects/11bfc7ecf63e4a22b494f7a7f7dd792c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:18.347586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bfc7ecf63e4a22b494f7a7f7dd792c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:18.349626 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:18.394975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bfc7ecf63e4a22b494f7a7f7dd792c', 'request_id': 'req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.400629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bfc7ecf63e4a22b494f7a7f7dd792c', 'request_id': 'req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.406615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bfc7ecf63e4a22b494f7a7f7dd792c', 'request_id': 'req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.418709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] The token cache is being invalidate because project 11bfc7ecf63e4a22b494f7a7f7dd792c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:18.418995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.419607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.421123 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1271/2551] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:18 2021] DELETE /identity/v3/projects/11bfc7ecf63e4a22b494f7a7f7dd792c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:18.425225 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:18.434977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8f657-5c8b-4de9-8a41-762154ed6993 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:18.487882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:18.488715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:18.488990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:18.489260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] PATH_INFO: `/v3/users/100129e4556540b595176e62f1815595` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:18.490424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100129e4556540b595176e62f1815595)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:18.492380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:18.535243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100129e4556540b595176e62f1815595'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.546143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100129e4556540b595176e62f1815595'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.553312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100129e4556540b595176e62f1815595'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.564730 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100129e4556540b595176e62f1815595'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.565355 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-024b824e-ace3-42ba-b90b-57653129fa35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100129e4556540b595176e62f1815595'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.570966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1281/2552] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:18 2021] DELETE /identity/v3/users/100129e4556540b595176e62f1815595 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:18.827682 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:18.829149 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:18.844855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff20cb2-8e76-4e3a-9fa7-40bfa573b622 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:18.899582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:18.900422 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:18.900693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:18.900956 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] PATH_INFO: `/v3/projects/809e690edf354740a5d90c23b8160760` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:18.902114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809e690edf354740a5d90c23b8160760)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:18.904015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:18.946365 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809e690edf354740a5d90c23b8160760', 'request_id': 'req-80e24521-c3b0-45f2-b349-eeda7fe7bc79'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.951441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809e690edf354740a5d90c23b8160760', 'request_id': 'req-80e24521-c3b0-45f2-b349-eeda7fe7bc79'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.957046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809e690edf354740a5d90c23b8160760', 'request_id': 'req-80e24521-c3b0-45f2-b349-eeda7fe7bc79'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.968032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] The token cache is being invalidate because project 809e690edf354740a5d90c23b8160760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:18.968312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.968914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-80e24521-c3b0-45f2-b349-eeda7fe7bc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:18.970361 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1272/2553] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:18 2021] DELETE /identity/v3/projects/809e690edf354740a5d90c23b8160760 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:18.976024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:18.976370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:18.977158 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:18.995116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:18.996295 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:19.050965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1282/2554] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:19.058638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.058925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.059199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.078497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:19.079709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:19.088067 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1273/2555] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:19.092071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.101362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1971-44b5-4b78-b032-a2466a6997b3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.105943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.106602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.106885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.107159 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.107884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:19.108188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.109774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.121094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1283/2556] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:19.125303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.135263 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de759d2-516e-486d-bdfb-8875a4a1427a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.139917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.140592 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.140978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.141240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.141970 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.143893 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.168665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1274/2557] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:19 2021] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:19.172943 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.182604 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c77a-be94-46a9-9acd-4803ca0a260c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.234530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.235141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.235422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.235698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.236395 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.238289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.257021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1284/2558] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:19 2021] POST /identity/v3/users => generated 302 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:19.261681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.271697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd8f6-91e4-48bf-9024-861acf2a4928 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.276925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.277570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.277845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.278114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.278881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.280441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.290382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1275/2559] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:19.294193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.303775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b69a2-d81a-4c14-978d-c5fd1b9c3f6c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.308388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.309024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.309334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.309610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.310343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.311948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b29a-b054-4d75-bc91-f52bf1dd20b3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.322016 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1285/2560] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:19 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:19.325838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.335227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e863dac-5c0d-46e0-8dc7-a587854177f8 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.340432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.341277 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.341554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.341824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] PATH_INFO: `/v3/projects/50c0d0d16bc144d792c4d24f69bb53fe/users/4b0373078d52482a8183417751a1c8fe/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.355866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c0d0d16bc144d792c4d24f69bb53fe, user_id=4b0373078d52482a8183417751a1c8fe, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.358483 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.370915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1276/2561] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:19 2021] PUT /identity/v3/projects/50c0d0d16bc144d792c4d24f69bb53fe/users/4b0373078d52482a8183417751a1c8fe/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:19.375825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e008d3-963e-4edf-af9f-af1c7ad6d111 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.376120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e008d3-963e-4edf-af9f-af1c7ad6d111 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.376404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e008d3-963e-4edf-af9f-af1c7ad6d111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.395143 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-67e008d3-963e-4edf-af9f-af1c7ad6d111 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:19.396316 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-67e008d3-963e-4edf-af9f-af1c7ad6d111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:19.451555 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1286/2562] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:19.461401 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:19.463082 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:19.516733 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209458-a2e2-44dc-b8da-c3b8d1c9ee14 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:19.520228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:19.520847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:19.521124 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:19.521395 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:19.530050 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:19.531478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:19.540488 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1277/2563] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:20.118116 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.118915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.119040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.144553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] MFA Rules not processed for user `4b0373078d52482a8183417751a1c8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:20.146122 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:20.207525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1287/2564] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:20 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:20.212464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.222252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c80d-6a98-4230-9899-0f913001347d service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.227381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.228088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.228369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.228833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.229646 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.231575 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.256528 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1278/2565] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:20 2021] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:20.260340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.270631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93d03-a42c-4695-b763-5f6a61fc95ca None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.324288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.324924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.325205 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.325476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.326181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.328106 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.348194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1288/2566] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:20 2021] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:20.353148 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.363225 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82391-ca50-42d4-acd5-a1426b183bed admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.368042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.368989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.369302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.369574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.370410 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.372134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.382874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1279/2567] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:20.386877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.396766 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0a6f-6bc0-4151-9d9d-f9314f8b7c72 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.401990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.402878 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.403151 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.403464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] PATH_INFO: `/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5/users/fd779345dcbf4657bd07354519c02ccc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.418607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bc5aa1860e484caf44b394b4fd31c5, user_id=fd779345dcbf4657bd07354519c02ccc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.421362 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.434171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1289/2568] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:20 2021] PUT /identity/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5/users/fd779345dcbf4657bd07354519c02ccc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:20.438169 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.448172 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb32b-3d39-43bb-b4fd-0900f6498919 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.502788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.503428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.503702 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.503969 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.504683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.506253 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f263f-8220-4bef-bb13-1289f7445fb9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.515456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1280/2569] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:20.519654 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:20.530109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac0d7-d89c-4cdf-bf58-2a0a43ddfe77 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:20.534664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:20.535523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:20.535857 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:20.536137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] PATH_INFO: `/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5/users/fd779345dcbf4657bd07354519c02ccc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:20.538095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bc5aa1860e484caf44b394b4fd31c5, user_id=fd779345dcbf4657bd07354519c02ccc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:20.541328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:20.551102 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1290/2570] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:20 2021] PUT /identity/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5/users/fd779345dcbf4657bd07354519c02ccc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:21.151780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:21.152059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:21.152333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:21.178151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] MFA Rules not processed for user `fd779345dcbf4657bd07354519c02ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:21.179932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:21.246234 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1281/2571] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:21 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:22.226520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:22.284911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937553-6601-4355-bb38-f91d80e9e0cf admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:22.289483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:22.290340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:22.290647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:22.290922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] PATH_INFO: `/v3/users/4b0373078d52482a8183417751a1c8fe` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:22.292117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0373078d52482a8183417751a1c8fe)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:22.294028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:22.336735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0373078d52482a8183417751a1c8fe'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.342970 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0373078d52482a8183417751a1c8fe'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.349578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0373078d52482a8183417751a1c8fe'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.360553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0373078d52482a8183417751a1c8fe'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.361182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0373078d52482a8183417751a1c8fe'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.366879 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1291/2572] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:22 2021] DELETE /identity/v3/users/4b0373078d52482a8183417751a1c8fe => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:22.535587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:22.546910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19f03-c36e-44e4-a742-12fcbeac3601 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:22.601926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:22.602818 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:22.603096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:22.603364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] PATH_INFO: `/v3/projects/50c0d0d16bc144d792c4d24f69bb53fe` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:22.604549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c0d0d16bc144d792c4d24f69bb53fe)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:22.606463 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:22.651420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c0d0d16bc144d792c4d24f69bb53fe', 'request_id': 'req-23865442-b6fa-4334-8e5f-f4d6c779ed7d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.656746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c0d0d16bc144d792c4d24f69bb53fe', 'request_id': 'req-23865442-b6fa-4334-8e5f-f4d6c779ed7d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.662573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c0d0d16bc144d792c4d24f69bb53fe', 'request_id': 'req-23865442-b6fa-4334-8e5f-f4d6c779ed7d'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.674369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] The token cache is being invalidate because project 50c0d0d16bc144d792c4d24f69bb53fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:22.674680 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.675291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.676771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1282/2573] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:22 2021] DELETE /identity/v3/projects/50c0d0d16bc144d792c4d24f69bb53fe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:22.681261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:22.682773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:22.695968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ead185-350f-44ea-a3d3-2079d420ac83 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:22.748532 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:22.749377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:22.749652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:22.749921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] PATH_INFO: `/v3/users/fd779345dcbf4657bd07354519c02ccc` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:22.751119 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd779345dcbf4657bd07354519c02ccc)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:22.753018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:22.797631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd779345dcbf4657bd07354519c02ccc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.804267 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd779345dcbf4657bd07354519c02ccc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.811595 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd779345dcbf4657bd07354519c02ccc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.822412 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd779345dcbf4657bd07354519c02ccc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.823056 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-879803b3-160f-414c-aae8-24e7cfd256fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd779345dcbf4657bd07354519c02ccc'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:22.828637 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1292/2574] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:22 2021] DELETE /identity/v3/users/fd779345dcbf4657bd07354519c02ccc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:22.990098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:22.991706 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:23.004694 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865442-b6fa-4334-8e5f-f4d6c779ed7d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.060751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.061600 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.061881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.062157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] PATH_INFO: `/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.063370 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bc5aa1860e484caf44b394b4fd31c5)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.065265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.109630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bc5aa1860e484caf44b394b4fd31c5', 'request_id': 'req-d2312def-51d6-4a12-a7d4-841aaa2c72f9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:23.114826 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bc5aa1860e484caf44b394b4fd31c5', 'request_id': 'req-d2312def-51d6-4a12-a7d4-841aaa2c72f9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:23.121440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bc5aa1860e484caf44b394b4fd31c5', 'request_id': 'req-d2312def-51d6-4a12-a7d4-841aaa2c72f9'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:23.133058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] The token cache is being invalidate because project c3bc5aa1860e484caf44b394b4fd31c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:23.133676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:23.134289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-d2312def-51d6-4a12-a7d4-841aaa2c72f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:23.135795 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1283/2575] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:22 2021] DELETE /identity/v3/projects/c3bc5aa1860e484caf44b394b4fd31c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:23.141458 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.141765 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.142035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.159781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:23.160964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:23.216646 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1293/2576] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:23.224211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.224502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.224782 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.244516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:23.245642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:23.253344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1284/2577] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:23.257330 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.266695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec259-9161-4783-a9c8-20d39314509a None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.271237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.271876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.272156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.272429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.273688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:23.273999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.275598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.286665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1294/2578] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:23.291076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.299856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bbae-7cbb-4c1b-8505-cf3330e4d9e0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.304658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.305301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.305578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.305849 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.306627 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.308452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.338042 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1285/2579] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:23.342157 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.352874 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2247-39bc-455a-9223-d377a8d592c0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.405396 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.406038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.406315 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.406611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.407299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.409171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.428650 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1295/2580] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:23.432851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.442908 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1feff2-0bac-44f8-b459-4725a73ccd3e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.447583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.448223 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.448499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.448771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.449499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.451141 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.461518 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1286/2581] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:23.465273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.476053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9477b-1cc5-4d7b-8fc5-03469142fe76 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.481329 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.481981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.482263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.482593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.483327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.484902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b495891-25a6-4761-a883-618362721bb6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.494901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1296/2582] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:57:23.498700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.508212 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab4e1-b3d5-48f5-822b-63cbf241e553 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.512857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.513709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.513983 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.514247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] PATH_INFO: `/v3/projects/a64453b1e9f24f539d8175efaf154ed0/users/0b0957b6fac142a6af8dd45edb976cb7/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.528470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64453b1e9f24f539d8175efaf154ed0, user_id=0b0957b6fac142a6af8dd45edb976cb7, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.531119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.544281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1287/2583] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:23 2021] PUT /identity/v3/projects/a64453b1e9f24f539d8175efaf154ed0/users/0b0957b6fac142a6af8dd45edb976cb7/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:23.555655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.555942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.556247 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.581980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] MFA Rules not processed for user `0b0957b6fac142a6af8dd45edb976cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:23.583199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:23.644111 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1297/2584] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:23.649112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.706761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba87e7-3081-4f6a-adc0-35e7f4915b38 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.712004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.712644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.712924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.713198 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.713900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.715816 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.739533 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1288/2585] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:23.743797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.754194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9c04-537b-402b-bf5d-e9c4c04704ea None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.812586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.813245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.813528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.813808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.814514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.816454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.836360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1298/2586] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:23 2021] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:23.840377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.850590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546043c1-ffb1-4236-b154-b57ece5f4bb1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.855259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.855903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.856188 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.856459 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.857192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.858801 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.869095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1289/2587] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:23.872959 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.882391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5e64-f362-4a57-88d1-6d7b5fd23d41 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.887476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.888324 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.888602 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.888875 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] PATH_INFO: `/v3/projects/0e13f88be82747aaba71a5279826b522/users/6ec6e2f536384416ba7c70e8da9a299a/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.903333 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e13f88be82747aaba71a5279826b522, user_id=6ec6e2f536384416ba7c70e8da9a299a, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.905947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.918328 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1299/2588] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:23 2021] PUT /identity/v3/projects/0e13f88be82747aaba71a5279826b522/users/6ec6e2f536384416ba7c70e8da9a299a/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:23.922178 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:23.932231 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136aa31-f451-4cda-8ddf-5620d687a34a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:23.984318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:23.985003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:23.985282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:23.985555 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:23.986313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:23.987955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596693f-cb0e-4e44-b5c2-e2de3572c2fd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:23.998434 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1290/2589] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:24.002437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:24.013052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59ce8-be23-42e8-a6c9-39414a3a6d77 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:24.017528 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:24.018387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.018699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.018974 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] PATH_INFO: `/v3/projects/0e13f88be82747aaba71a5279826b522/users/6ec6e2f536384416ba7c70e8da9a299a/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.020928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e13f88be82747aaba71a5279826b522, user_id=6ec6e2f536384416ba7c70e8da9a299a, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:24.023577 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:24.033282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1300/2590] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:24 2021] PUT /identity/v3/projects/0e13f88be82747aaba71a5279826b522/users/6ec6e2f536384416ba7c70e8da9a299a/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:24.043306 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7028-c964-43da-af21-e064a0982356 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.043591 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7028-c964-43da-af21-e064a0982356 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.043864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7028-c964-43da-af21-e064a0982356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.071475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-44ec7028-c964-43da-af21-e064a0982356 None None] MFA Rules not processed for user `6ec6e2f536384416ba7c70e8da9a299a`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:24.072665 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-44ec7028-c964-43da-af21-e064a0982356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:24.137241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1291/2591] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:24 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:24.143027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:24.201439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174139a-4c25-4e11-9c10-2f8fc04d82a0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:24.206289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:24.207180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.207454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.207726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] PATH_INFO: `/v3/users/0b0957b6fac142a6af8dd45edb976cb7` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.209029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0957b6fac142a6af8dd45edb976cb7)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:24.211001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:24.256461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0957b6fac142a6af8dd45edb976cb7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.264017 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0957b6fac142a6af8dd45edb976cb7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.270424 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0957b6fac142a6af8dd45edb976cb7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.281415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0957b6fac142a6af8dd45edb976cb7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.282055 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0957b6fac142a6af8dd45edb976cb7'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.287716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1301/2592] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:24 2021] DELETE /identity/v3/users/0b0957b6fac142a6af8dd45edb976cb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:24.292952 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.293276 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.293558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.311476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:24.312666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:24.367900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1292/2593] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:24.377948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:24.379361 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:24.433183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb83a0d-56b5-4bbd-91c2-341841ed57ce admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:24.436780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:24.437401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.437679 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.437950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.446586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:24.447994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:24.457237 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1302/2594] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:24.721603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:24.723073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:24.734857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6bdb-a225-4d35-a47b-07687ac62321 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:24.739429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:24.740281 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.740561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.740830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] PATH_INFO: `/v3/projects/a64453b1e9f24f539d8175efaf154ed0` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.742868 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64453b1e9f24f539d8175efaf154ed0)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:24.744900 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:24.789032 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64453b1e9f24f539d8175efaf154ed0', 'request_id': 'req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.794240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64453b1e9f24f539d8175efaf154ed0', 'request_id': 'req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.800018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64453b1e9f24f539d8175efaf154ed0', 'request_id': 'req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.812203 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] The token cache is being invalidate because project a64453b1e9f24f539d8175efaf154ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:24.812486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.813096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.814641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1293/2595] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:24 2021] DELETE /identity/v3/projects/a64453b1e9f24f539d8175efaf154ed0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:24.818663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:24.828507 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5ac2-10da-4e7b-9f41-90ddd852417e service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:24.880999 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:24.881842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:24.882120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:24.882397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] PATH_INFO: `/v3/users/6ec6e2f536384416ba7c70e8da9a299a` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:24.884163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec6e2f536384416ba7c70e8da9a299a)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:24.886061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:24.927863 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec6e2f536384416ba7c70e8da9a299a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.935021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec6e2f536384416ba7c70e8da9a299a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.941492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec6e2f536384416ba7c70e8da9a299a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.953380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec6e2f536384416ba7c70e8da9a299a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.954010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-b6cd5375-f4c5-4680-b34a-840c47026705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec6e2f536384416ba7c70e8da9a299a'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:24.959695 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1303/2596] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:24 2021] DELETE /identity/v3/users/6ec6e2f536384416ba7c70e8da9a299a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:25.215118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.216677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:25.231469 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052bab4-bb3f-4bfa-9ed0-4a913c347aa4 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.284715 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.285558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.285837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.286106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] PATH_INFO: `/v3/projects/0e13f88be82747aaba71a5279826b522` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.287288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e13f88be82747aaba71a5279826b522)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.289761 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.332937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e13f88be82747aaba71a5279826b522', 'request_id': 'req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:25.337878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e13f88be82747aaba71a5279826b522', 'request_id': 'req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:25.343529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e13f88be82747aaba71a5279826b522', 'request_id': 'req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:25.355342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] The token cache is being invalidate because project 0e13f88be82747aaba71a5279826b522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:25.355655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:25.356261 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ebc3aa59-7b3d-4ccb-aaf2-605417acc9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:25.357772 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1294/2597] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:25 2021] DELETE /identity/v3/projects/0e13f88be82747aaba71a5279826b522 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:25.363733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.364213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.364312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.382599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:25.383882 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:25.442072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1304/2598] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:25.449726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.450004 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.450272 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.468456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:25.469638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:25.477934 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1295/2599] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:25.481907 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.491265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db61dd-9b9d-4711-8bc8-fc3f045a2e59 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.496045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.496663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.496942 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.497215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.497940 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:25.498243 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.499851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.510830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1305/2600] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:25.515079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.524541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3d11-7e68-4296-99a3-9e4581bfdd3b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.529158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.529837 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.530131 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.530387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.531136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.532999 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.557727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1296/2601] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:25.561813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.571350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79d79-5945-4337-9508-9e5586eb7752 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.625349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.625923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.626199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.626468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.627182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.629053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.652299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1306/2602] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:25.653526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.663550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a311-6d9e-4dc6-a036-a0e553cb3a54 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.668628 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.669273 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.669551 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.669824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.670606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.672179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.682064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1297/2603] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:25.685811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.695397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c674f8-7c55-47f1-a81d-11b6b9a6dfea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.700248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.700934 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.701219 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.701524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.702276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.703915 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841f111-8c95-4d64-af47-68fb0eedc05a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.714283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1307/2604] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:25.718075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.728334 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71444ba-c46f-45cb-9d04-dbd966b601d2 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.732947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.733797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.734074 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.734342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] PATH_INFO: `/v3/projects/ec75ac4c80144cc4af0884792b0bfe6d/users/eb6ec027ebe840269d58a06a53516eb2/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.748318 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec75ac4c80144cc4af0884792b0bfe6d, user_id=eb6ec027ebe840269d58a06a53516eb2, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.750979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.763337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1298/2605] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:25 2021] PUT /identity/v3/projects/ec75ac4c80144cc4af0884792b0bfe6d/users/eb6ec027ebe840269d58a06a53516eb2/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:25.774892 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.775177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.775448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.800798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] MFA Rules not processed for user `eb6ec027ebe840269d58a06a53516eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:25.801983 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:25.861632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1308/2606] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:25.866151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.923541 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa3f7-4532-414e-b693-672e5e1cef8d admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:25.928038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:25.928673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:25.928953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:25.929227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:25.929923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:25.931839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:25.956751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1299/2607] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:25.960500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:25.971302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a184-5668-40ef-ab3f-9f24519cad5b None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.025166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.025825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.026108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.026386 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.027133 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.029035 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.048155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1309/2608] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:25 2021] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:26.052096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.062108 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7e880-357b-4543-8741-7ac40e72b655 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.066737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.067380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.067659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.067931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.068663 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.071739 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.081065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1300/2609] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:26.085222 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.095773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de28b5-0126-492d-9931-8861f29aecea admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.100305 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.101185 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.101477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.101746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] PATH_INFO: `/v3/projects/5a934ef819a041009f128455f1c37f0e/users/d440091d59734f74aa4e761f883e86cc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.115591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a934ef819a041009f128455f1c37f0e, user_id=d440091d59734f74aa4e761f883e86cc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.118181 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.130859 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1310/2610] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:26 2021] PUT /identity/v3/projects/5a934ef819a041009f128455f1c37f0e/users/d440091d59734f74aa4e761f883e86cc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:26.135421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.145025 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc165b6-ae7c-406c-b24b-02e73e36aec0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.199642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.200222 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.200503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.200775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.201505 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.203134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb3844-b3f4-41a3-aa11-a12cb53b32d5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.212427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1301/2611] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:26 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:26.216607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.226440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ed59-4337-4ef8-adbe-3a9ab1dd5281 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.231044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.231899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.232179 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.232452 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] PATH_INFO: `/v3/projects/5a934ef819a041009f128455f1c37f0e/users/d440091d59734f74aa4e761f883e86cc/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.234413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a934ef819a041009f128455f1c37f0e, user_id=d440091d59734f74aa4e761f883e86cc, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.237064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.247670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1311/2612] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:26 2021] PUT /identity/v3/projects/5a934ef819a041009f128455f1c37f0e/users/d440091d59734f74aa4e761f883e86cc/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:26.258252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.258537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.258839 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.283617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] MFA Rules not processed for user `d440091d59734f74aa4e761f883e86cc`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:26.284797 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:26.347290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1302/2613] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:26 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:26.357788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.359445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:26.413193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c2de9-f7e9-4683-a881-840694e18cb1 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.416910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.417537 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.417817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.418093 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.426716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.428123 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348d26e-da00-4c9a-a62f-1adc4c2f7b8f service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.437642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1312/2614] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:26 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:26.464420 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.523034 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1c73c-4d0f-4b84-ad15-7d149577371e None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.527635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.528476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.528754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.529026 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] PATH_INFO: `/v3/users/eb6ec027ebe840269d58a06a53516eb2` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.530221 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6ec027ebe840269d58a06a53516eb2)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.532168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.575487 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6ec027ebe840269d58a06a53516eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:26.586499 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6ec027ebe840269d58a06a53516eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:26.593400 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6ec027ebe840269d58a06a53516eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:26.594080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6ec027ebe840269d58a06a53516eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:26.594741 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6ec027ebe840269d58a06a53516eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:26.606681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1303/2615] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:26 2021] DELETE /identity/v3/users/eb6ec027ebe840269d58a06a53516eb2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:26.611229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.611519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.611842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.630731 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:26.631923 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:26.687575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1313/2616] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:26.697408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:26.698894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:26.754342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e29ec-7fb1-4386-921b-78ca08622fa9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:26.758299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:26.758964 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:26.759239 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:26.759507 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:26.768283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:26.769692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:26.778735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1304/2617] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:27.028373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.029865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:27.042663 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317ea2-6476-497a-80ec-88e30fe6a8b1 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.047286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.048587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.048885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.049152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] PATH_INFO: `/v3/projects/ec75ac4c80144cc4af0884792b0bfe6d` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.050527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec75ac4c80144cc4af0884792b0bfe6d)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.052443 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.096121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec75ac4c80144cc4af0884792b0bfe6d', 'request_id': 'req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.101822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec75ac4c80144cc4af0884792b0bfe6d', 'request_id': 'req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.108030 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec75ac4c80144cc4af0884792b0bfe6d', 'request_id': 'req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.118696 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] The token cache is being invalidate because project ec75ac4c80144cc4af0884792b0bfe6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:27.119003 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.119630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.121121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1314/2618] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:27 2021] DELETE /identity/v3/projects/ec75ac4c80144cc4af0884792b0bfe6d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:27.125073 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.134313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40560c8-a375-42f5-8deb-6b0d0efa9ce9 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.188055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.188901 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.189181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.189450 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] PATH_INFO: `/v3/users/d440091d59734f74aa4e761f883e86cc` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.190656 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d440091d59734f74aa4e761f883e86cc)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.192586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.234333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd440091d59734f74aa4e761f883e86cc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.245376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd440091d59734f74aa4e761f883e86cc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.251824 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd440091d59734f74aa4e761f883e86cc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.252611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd440091d59734f74aa4e761f883e86cc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.253205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-cd837c6b-2702-4237-8ccb-9d1a15a413de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd440091d59734f74aa4e761f883e86cc'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.264987 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1305/2619] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:27 2021] DELETE /identity/v3/users/d440091d59734f74aa4e761f883e86cc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:27.523755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.525178 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:27.538126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d77db9-7dbc-4c3c-ad46-3ff565aa37c8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.592340 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.593180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.593456 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.593728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] PATH_INFO: `/v3/projects/5a934ef819a041009f128455f1c37f0e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.594925 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a934ef819a041009f128455f1c37f0e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.596796 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.639166 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a934ef819a041009f128455f1c37f0e', 'request_id': 'req-a844d088-90f7-455a-8559-afd71c0d9357'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.644248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a934ef819a041009f128455f1c37f0e', 'request_id': 'req-a844d088-90f7-455a-8559-afd71c0d9357'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.651521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a934ef819a041009f128455f1c37f0e', 'request_id': 'req-a844d088-90f7-455a-8559-afd71c0d9357'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.661885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] The token cache is being invalidate because project 5a934ef819a041009f128455f1c37f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:27.662165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.662800 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-a844d088-90f7-455a-8559-afd71c0d9357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:27.664347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1315/2620] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:27 2021] DELETE /identity/v3/projects/5a934ef819a041009f128455f1c37f0e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:27.670142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.670496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.670832 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.688312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:27.689500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:27.745127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1306/2621] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:27.752966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.753249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.753523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.771672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:27.772779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:27.780701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1316/2622] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:27.784886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.794166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe23ad2-1c43-4191-8c53-737f7ac4109a None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.798635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.799275 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.799550 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.799819 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.800538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:27.800838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.802405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.813796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1307/2623] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:27.817778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.827292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfa876-4569-459c-8629-0898b34a0de2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.831951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.832585 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.832870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.833150 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.833847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.835760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.860374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1317/2624] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:27 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:27.864478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.874866 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce83bc-f087-4f14-8eeb-cafaff8535a0 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.926167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.926835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.927112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.927377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.928069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.930455 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.950515 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1308/2625] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:27 2021] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:27.954383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.964431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15747459-10d8-48a3-8192-423721f58c06 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:27.969061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:27.969709 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:27.969992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:27.970270 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:27.971040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:27.972630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:27.983867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1318/2626] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:27.987723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:27.998789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f64c7-cf15-4fd8-a650-06aac33b0054 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.003381 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.004023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.004303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.004574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.005302 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.006917 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c8a96-0d92-4f77-815e-76860a9eeb8a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.017187 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1309/2627] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:28.021531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.031202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166b55-bda2-40b8-9a08-23c1629e50a8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.035649 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.036496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.036771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.037040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] PATH_INFO: `/v3/projects/f9ccca6f35f84ece9253d81b238fe8ca/users/e642fab26dbf485dbe53915c6d23777f/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.051437 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ccca6f35f84ece9253d81b238fe8ca, user_id=e642fab26dbf485dbe53915c6d23777f, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.054190 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.067714 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1319/2628] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:28 2021] PUT /identity/v3/projects/f9ccca6f35f84ece9253d81b238fe8ca/users/e642fab26dbf485dbe53915c6d23777f/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:28.078745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.079035 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.079315 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.105065 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] MFA Rules not processed for user `e642fab26dbf485dbe53915c6d23777f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:28.106267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:28.167574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1310/2629] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:28 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:28.172112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.229082 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c90e5-85cf-4fe9-b19c-2b903e75cdde admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.233629 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.234257 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.234531 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.234833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.235521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.237385 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.261832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1320/2630] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:28 2021] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:28.265911 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.276184 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabcfa7-6ceb-43e0-95d0-4bbf8f8e575f None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.328725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.329371 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.329648 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.329918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.330752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.332672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.352903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1311/2631] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:28 2021] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:28.356941 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.367493 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c666-b264-4313-aaf2-82e181c079ed admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.372549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.373195 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.373471 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.373738 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.374488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.376069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.386169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1321/2632] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:28.390018 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.399446 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c81c-d279-483c-92e8-c4adc1697bb6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.403947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.404802 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.405076 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.405344 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] PATH_INFO: `/v3/projects/dd4d35567ed94f719999abb10048cc22/users/7559c725f87d4c1c875264772d3c161e/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.419695 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d35567ed94f719999abb10048cc22, user_id=7559c725f87d4c1c875264772d3c161e, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.422290 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.435408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1312/2633] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:28 2021] PUT /identity/v3/projects/dd4d35567ed94f719999abb10048cc22/users/7559c725f87d4c1c875264772d3c161e/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:28.439208 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.448676 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9115f0-aff0-4dc3-905c-8ff368c0b483 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.501552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.502196 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.502476 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.502774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.503491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.505050 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc926-9364-4626-972a-614be090a368 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.514155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1322/2634] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:28 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:57:28.518129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.529128 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb353-bbe2-40db-afb0-325245c30332 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.533789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.534676 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.534957 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.535229 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] PATH_INFO: `/v3/projects/dd4d35567ed94f719999abb10048cc22/users/7559c725f87d4c1c875264772d3c161e/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.537207 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d35567ed94f719999abb10048cc22, user_id=7559c725f87d4c1c875264772d3c161e, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.540489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.550631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1313/2635] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:28 2021] PUT /identity/v3/projects/dd4d35567ed94f719999abb10048cc22/users/7559c725f87d4c1c875264772d3c161e/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:28.561248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.561902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.561902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.587652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] MFA Rules not processed for user `7559c725f87d4c1c875264772d3c161e`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:28.588778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:28.653217 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1323/2636] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:28 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:28.664862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.666535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:28.719877 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0462b5-0a9c-469e-bd0e-41d899978aab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.723508 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.724138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.724417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.724688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.734000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.735454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.744778 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1314/2637] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:28 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:28.810957 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:28.820770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e1a1-7c77-4c8a-9fd5-57438edc67e8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:28.824363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:28.824989 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:28.825266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:28.825539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:28.878627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:28.879997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01583f0b-b7f2-4e9e-aa69-2b7793f1ca5b service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:28.889173 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1324/2638] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:28 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:29.121765 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:29.181031 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ac91-80e2-4263-b5dc-81bc4db5434c service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:29.185467 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:29.186311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.186614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.186890 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] PATH_INFO: `/v3/users/e642fab26dbf485dbe53915c6d23777f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.188066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e642fab26dbf485dbe53915c6d23777f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:29.189967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:29.232546 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e642fab26dbf485dbe53915c6d23777f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.244433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e642fab26dbf485dbe53915c6d23777f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.250961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e642fab26dbf485dbe53915c6d23777f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.251751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e642fab26dbf485dbe53915c6d23777f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.252348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e642fab26dbf485dbe53915c6d23777f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.264915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1315/2639] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:29 2021] DELETE /identity/v3/users/e642fab26dbf485dbe53915c6d23777f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:29.269543 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.269960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.270162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.286902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:29.288104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:29.341910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1325/2640] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:29.351747 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:29.353240 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:29.407033 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a43ae-f024-4884-b35c-1349796e7917 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:29.410618 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:29.411243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.411517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.411787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.420366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:29.421803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:29.431360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1316/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:29.607147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:29.617392 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0681bbe-1f7d-4828-915a-13bbca4d5fe5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:29.622505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:29.623193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.623475 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.623748 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.625492 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:29.682391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:29.683886 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:29.686598 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:29.688409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:29.693527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1326/2642] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:29 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:29.703855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57080e4-d5c7-4866-a077-36755e69abd9 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:29.709088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:29.710918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.710918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.710918 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] PATH_INFO: `/v3/projects/f9ccca6f35f84ece9253d81b238fe8ca` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.711937 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ccca6f35f84ece9253d81b238fe8ca)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:29.713561 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:29.761288 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ccca6f35f84ece9253d81b238fe8ca', 'request_id': 'req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.766621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ccca6f35f84ece9253d81b238fe8ca', 'request_id': 'req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.772554 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ccca6f35f84ece9253d81b238fe8ca', 'request_id': 'req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.784734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] The token cache is being invalidate because project f9ccca6f35f84ece9253d81b238fe8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:29.785036 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.785614 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.787153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1317/2643] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:29 2021] DELETE /identity/v3/projects/f9ccca6f35f84ece9253d81b238fe8ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:29.791605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:29.802271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8486f3b-6890-4af3-9f1d-cbec47f91458 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:29.855609 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:29.856482 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:29.856761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:29.857034 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] PATH_INFO: `/v3/users/7559c725f87d4c1c875264772d3c161e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:29.858250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7559c725f87d4c1c875264772d3c161e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:29.860214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:29.904804 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7559c725f87d4c1c875264772d3c161e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.911376 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7559c725f87d4c1c875264772d3c161e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.919114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7559c725f87d4c1c875264772d3c161e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.931207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7559c725f87d4c1c875264772d3c161e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.932008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-50f7a62f-e486-456e-a3d8-fac2b166ab57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7559c725f87d4c1c875264772d3c161e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:29.937707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1327/2644] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:29 2021] DELETE /identity/v3/users/7559c725f87d4c1c875264772d3c161e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:30.382230 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.384259 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:30.396564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7c66-1e19-4374-8f04-02492a5d1ea1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.450407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.451206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.451478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.451742 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] PATH_INFO: `/v3/projects/dd4d35567ed94f719999abb10048cc22` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.452954 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d35567ed94f719999abb10048cc22)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.454855 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.499573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d35567ed94f719999abb10048cc22', 'request_id': 'req-de69a10c-b073-444f-b6d2-1b9ab68948a2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:30.505071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d35567ed94f719999abb10048cc22', 'request_id': 'req-de69a10c-b073-444f-b6d2-1b9ab68948a2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:30.512327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d35567ed94f719999abb10048cc22', 'request_id': 'req-de69a10c-b073-444f-b6d2-1b9ab68948a2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:30.526312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] The token cache is being invalidate because project dd4d35567ed94f719999abb10048cc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:30.526625 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:30.527283 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-de69a10c-b073-444f-b6d2-1b9ab68948a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:30.528888 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1318/2645] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:30 2021] DELETE /identity/v3/projects/dd4d35567ed94f719999abb10048cc22 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:30.535245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.535522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.535788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.554462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:30.555721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:30.622697 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1328/2646] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:30.630478 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.630867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.631242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.651134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:30.652521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:30.660513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1319/2647] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:30.664982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.675002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6cd0-c9fa-4289-a128-2fefb1b71be5 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.680203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.680872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.681155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.681428 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.682183 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:30.682488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.684126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.696903 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1329/2648] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:30.701492 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.711245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091af0a-a89c-44c8-b6da-57ee05a2df30 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.716397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.717062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.717340 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.717620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.718323 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.720292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.746269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1320/2649] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:30 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:30.750318 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.761460 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1253ab-2e54-4645-9d96-8a0990210b88 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.815958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.816631 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.816914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.817189 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.817901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.820440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.842812 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1330/2650] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:30 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:30.846876 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.861982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0170755-2f27-451e-8132-d8e0842fc52b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.867630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.868605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.869070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.869337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.870080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.871927 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.886228 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1321/2651] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:30.892746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.903516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1fa8-4257-412e-8510-1da1fd426dd2 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.909301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.909301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.909301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.909705 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.910288 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.911901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.930835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.932775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1331/2652] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:30.933216 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:30.936735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:30.947963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4738-c49a-4a51-aa68-a9796c12a3e3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:30.953203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:30.954228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:30.954611 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:30.954962 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] PATH_INFO: `/v3/projects/b209123a031643e1b7f475f8dec339bd/users/681647b753254ecca504f3fbc5b58066/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:30.971213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b209123a031643e1b7f475f8dec339bd, user_id=681647b753254ecca504f3fbc5b58066, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:30.978536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69fe52-adca-4afb-998e-238314f050d4 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:30.996660 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1332/2653] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:30 2021] PUT /identity/v3/projects/b209123a031643e1b7f475f8dec339bd/users/681647b753254ecca504f3fbc5b58066/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:31.008297 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:31.008612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:31.008894 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:31.013590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d128f-dd7c-4911-9aea-51c763c0446f admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:31.042317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] MFA Rules not processed for user `681647b753254ecca504f3fbc5b58066`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:31.044201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:31.087825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:31.088563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:31.088912 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:31.089576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:31.091521 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:31.105788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:31.107559 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:31.131307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1322/2654] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:31.137535 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:31.139132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:31.139567 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1333/2655] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:31 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:31.199688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0816-0739-4526-86e0-0d885f98dfc3 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:31.203771 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:31.203921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:31.204829 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:31.205116 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:31.205393 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:31.205673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:31.214454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:31.216030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e20b9-d352-4f1d-bf50-3ebe1c88b646 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:31.225312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1323/2656] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:31.273430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bd870-123d-41ee-a5f8-c7791c8db9a7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:31.277435 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:31.278276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:31.278750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:31.279202 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:31.281191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:31.291827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:31.293284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:31.301420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1334/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:32.583979 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:32.584464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:32.584560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:32.601887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] MFA Rules not processed for user `681647b753254ecca504f3fbc5b58066`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:32.603103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:32.609913 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1324/2658] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:32 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:33.109937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:33.111960 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:33.190065 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d162-5c52-4f63-a9a8-49b67512c6a4 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:33.195847 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:33.196488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:33.196768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:33.197045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:33.198902 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:33.210188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:33.211833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:33.221505 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1335/2659] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:34.773806 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:34.775568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:34.787119 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828677-10b9-4e97-9192-9bb44379b9a8 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:34.791408 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:34.792109 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:34.792451 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:34.792787 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:34.794990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:34.856438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:34.857905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:34.868936 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1325/2660] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:41.438265 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:41.439824 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:41.453556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdc05-242f-4ad9-89e5-aaec505b4967 service placement] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:41.458063 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:41.458978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:41.459250 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:41.459519 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] PATH_INFO: `/v3/users/1e832293b7d74dc9bf0ee30104162054` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:41.461230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e832293b7d74dc9bf0ee30104162054)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:41.463141 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:41.513536 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e832293b7d74dc9bf0ee30104162054'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.522020 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e832293b7d74dc9bf0ee30104162054'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.529910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e832293b7d74dc9bf0ee30104162054'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.541953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e832293b7d74dc9bf0ee30104162054'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.542737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e832293b7d74dc9bf0ee30104162054'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.548545 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1336/2661] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:41 2021] DELETE /identity/v3/users/1e832293b7d74dc9bf0ee30104162054 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:41.730009 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:41.740296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf3404-af7f-4e3b-8927-99231314d594 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:41.797418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:41.798256 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:41.798532 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:41.798854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] PATH_INFO: `/v3/projects/3d9bbc61321a47abb852671e78856939` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:41.800013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9bbc61321a47abb852671e78856939)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:41.801896 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:41.845134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9bbc61321a47abb852671e78856939', 'request_id': 'req-ddcb2324-51f1-4e45-b554-8a7516b63b3a'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.850245 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9bbc61321a47abb852671e78856939', 'request_id': 'req-ddcb2324-51f1-4e45-b554-8a7516b63b3a'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.856171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9bbc61321a47abb852671e78856939', 'request_id': 'req-ddcb2324-51f1-4e45-b554-8a7516b63b3a'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.867556 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] The token cache is being invalidate because project 3d9bbc61321a47abb852671e78856939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:41.868037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.868990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:41.870511 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1326/2662] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:41 2021] DELETE /identity/v3/projects/3d9bbc61321a47abb852671e78856939 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:41.874608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:41.875997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:41.889145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c393d5-0059-452a-9a9d-dd0b16a6a79e admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:41.943674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:41.944502 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:41.945299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:41.945570 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] PATH_INFO: `/v3/users/cfc7f5a510884d209eee1fb948d6c0bf` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:41.946780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc7f5a510884d209eee1fb948d6c0bf)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:41.948716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.000064 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc7f5a510884d209eee1fb948d6c0bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.008498 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc7f5a510884d209eee1fb948d6c0bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.015319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc7f5a510884d209eee1fb948d6c0bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.026620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc7f5a510884d209eee1fb948d6c0bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.027309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc7f5a510884d209eee1fb948d6c0bf'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.033021 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1337/2663] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:41 2021] DELETE /identity/v3/users/cfc7f5a510884d209eee1fb948d6c0bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:42.077636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.079920 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.164932 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2324-51f1-4e45-b554-8a7516b63b3a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.211652 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.213129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.233357 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.234227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.234726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.235043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.237311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.250700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.252284 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46c4a-0807-4180-baa2-0f33f0292b0d service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.263246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1327/2664] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:42.280197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167287-4d91-4e87-a025-bf972f9e889c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.285483 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.286403 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.286768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.287114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] PATH_INFO: `/v3/projects/05ded8decfef4c8fa900c664ca483ca0` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.288952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ded8decfef4c8fa900c664ca483ca0)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.290949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.337199 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ded8decfef4c8fa900c664ca483ca0', 'request_id': 'req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.342349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ded8decfef4c8fa900c664ca483ca0', 'request_id': 'req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.350565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ded8decfef4c8fa900c664ca483ca0', 'request_id': 'req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.362603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] The token cache is being invalidate because project 05ded8decfef4c8fa900c664ca483ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:42.362885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.363512 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-9e7ba2ef-76d5-4a79-bddc-d1322cee2010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:42.365023 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1338/2665] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:42 2021] DELETE /identity/v3/projects/05ded8decfef4c8fa900c664ca483ca0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:42.371753 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.372043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.372322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.390503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:42.392100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.450857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1328/2666] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:42.459069 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.459621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.459621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.478608 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:42.480018 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.488000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1339/2667] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:42.492749 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.502193 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11f39-3a4b-450a-afe7-2270475f6589 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.507209 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.507863 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.508139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.508409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.509180 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:57:42.509480 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.511132 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.522333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1329/2668] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:57:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:57:42.526436 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.535431 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ca4aa-89bc-4a08-a19a-c7f71e3947a7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.540623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.541263 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.541541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.541811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.542530 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.544415 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.569260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1340/2669] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:42 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:42.573255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.582978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda4972-41b0-4046-bd6e-d492735801de admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.636096 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.636745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.637023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.637293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.637980 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.639899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.661099 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1330/2670] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:42 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:57:42.664887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.675094 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487dbc-a27f-455c-94a9-e3f4596c97ee admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.680345 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.680992 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.681269 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.681539 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.682276 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.683896 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.694442 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1341/2671] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:42.698746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.708504 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f42304-b682-4972-8657-cb2fc2f02373 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.713573 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.714328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.714745 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.715086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.716008 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.717603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc87a9-90ae-41dd-abea-6b9209da1ba5 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.729717 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1331/2672] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:57:42.733808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.744465 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972cc2-34aa-4ffa-b224-b304edcbd643 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.749156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.750059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.750337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.750643 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] PATH_INFO: `/v3/projects/49ea8b6622bb40109191097fe33b666a/users/afdb1609b19c483488024719232bdd7b/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.765842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ea8b6622bb40109191097fe33b666a, user_id=afdb1609b19c483488024719232bdd7b, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.768526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.782153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1342/2673] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:42 2021] PUT /identity/v3/projects/49ea8b6622bb40109191097fe33b666a/users/afdb1609b19c483488024719232bdd7b/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:42.788471 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bad4d-6014-465c-b55c-757e56f48135 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.788967 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bad4d-6014-465c-b55c-757e56f48135 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.789147 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bad4d-6014-465c-b55c-757e56f48135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.809037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-8e5bad4d-6014-465c-b55c-757e56f48135 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:42.810814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8e5bad4d-6014-465c-b55c-757e56f48135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.872403 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1332/2674] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:42.882755 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:42.884429 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:42.937472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e242de-5046-46d7-b6c7-a05f27d10c5c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:42.940978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:42.941599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:42.941876 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:42.942152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:42.951373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:42.952779 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:42.961852 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1343/2675] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:57:47.305847 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.306375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.306375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.339030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] MFA Rules not processed for user `afdb1609b19c483488024719232bdd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:47.340269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:47.405191 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1333/2676] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:47 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:57:47.409808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.420182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a20d-ef02-46ae-b9c8-e290ad613a1f service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.424895 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.425549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.425832 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.426374 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.427154 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.429572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.456425 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1344/2677] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:57:47 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:47.460497 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.472780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795cf05-e825-48c2-9e66-2a6fa2829142 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.529464 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.530138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.530417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.530751 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.531475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.533503 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.558595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1334/2678] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:57:47 2021] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:57:47.559758 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.572560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff8fa-fccb-4ccf-904e-befb497fe3b7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.579854 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.580554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.580840 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.581124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.583180 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.584838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.596138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1345/2679] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:47 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:57:47.600407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.611113 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ff94-2a25-4cc8-8281-974e2a380c85 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.615792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.617363 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.617596 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.617756 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] PATH_INFO: `/v3/projects/6d90908cbc64405bb0a5aa3be03759cd/users/df8b353bcb3e40e3945c3ff2cc9a821b/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.633637 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d90908cbc64405bb0a5aa3be03759cd, user_id=df8b353bcb3e40e3945c3ff2cc9a821b, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.636337 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.649720 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1335/2680] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:47 2021] PUT /identity/v3/projects/6d90908cbc64405bb0a5aa3be03759cd/users/df8b353bcb3e40e3945c3ff2cc9a821b/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:47.653672 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.664176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177989-65f6-4fd8-9a8b-138e4b45235a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.726045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.726684 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.726971 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.727248 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.728010 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.729584 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f5429-96e5-4048-a923-1d8671cf8569 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.738953 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1346/2681] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:57:47 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:57:47.743916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:47.753792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d7c1-0ab8-47b0-9e1c-beb3259c239a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:47.758442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:47.759329 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:47.759611 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:47.759886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] PATH_INFO: `/v3/projects/6d90908cbc64405bb0a5aa3be03759cd/users/df8b353bcb3e40e3945c3ff2cc9a821b/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:47.761850 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d90908cbc64405bb0a5aa3be03759cd, user_id=df8b353bcb3e40e3945c3ff2cc9a821b, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:47.764500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:47.774297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1336/2682] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:57:47 2021] PUT /identity/v3/projects/6d90908cbc64405bb0a5aa3be03759cd/users/df8b353bcb3e40e3945c3ff2cc9a821b/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:48.010230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e945-c4ba-43f7-b918-dca9513b2f6e None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:48.010522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e945-c4ba-43f7-b918-dca9513b2f6e None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:48.010838 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e945-c4ba-43f7-b918-dca9513b2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:48.029693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-9e23e945-c4ba-43f7-b918-dca9513b2f6e None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:48.030937 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-9e23e945-c4ba-43f7-b918-dca9513b2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:48.091687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1347/2683] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:57:48 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:48.122345 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:48.124915 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:48.209286 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6167-b6f2-49d7-852c-7d5bf75c1bad admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:48.215332 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:48.215990 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:48.216293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:48.216564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:48.224712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:48.226926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:48.235158 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1337/2684] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:57:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:57:48.943426 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9e29-b257-424e-b73f-fdec36787eed None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:48.943961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9e29-b257-424e-b73f-fdec36787eed None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:48.943961 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af9e29-b257-424e-b73f-fdec36787eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:48.965807 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-89af9e29-b257-424e-b73f-fdec36787eed None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:48.967561 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-89af9e29-b257-424e-b73f-fdec36787eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:48.976962 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1348/2685] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Oct 18 18:57:48 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:48.994763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:49.006601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c44ef-d75a-4a85-8796-a2a40f76d479 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:49.012445 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:49.013070 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:49.013529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:49.013805 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:49.023206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:49.024788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:49.032930 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1338/2686] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:57:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:57:49.410607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:49.411197 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:49.411671 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:49.430850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] MFA Rules not processed for user `d90d673d13f1441e8fc551b7d0fe7f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:49.432193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:49.440214 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1349/2687] 10.222.0.36 () {58 vars in 967 bytes} [Mon Oct 18 18:57:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:49.453909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:49.464800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f190bc-e1a9-4ead-8880-1a179ef32764 service swift] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:49.470624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43005d7c7ec4c14bd0708164c20fe53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:49.471394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:49.471845 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:49.472282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:49.480904 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:49.482851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4452d-b3ba-4d91-9244-d6ec8e8207d6 service swift] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:49.495636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1339/2688] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Oct 18 18:57:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 18:57:51.913006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:51.914522 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:52.035216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c780-1a76-49f9-a2d6-b24392aea5d3 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:52.040549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:52.041413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:52.041689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:52.041963 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] PATH_INFO: `/v3/users/681647b753254ecca504f3fbc5b58066` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:52.043933 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681647b753254ecca504f3fbc5b58066)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:52.046640 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:52.128770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681647b753254ecca504f3fbc5b58066'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:52.140479 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681647b753254ecca504f3fbc5b58066'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:52.153001 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681647b753254ecca504f3fbc5b58066'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:52.180496 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681647b753254ecca504f3fbc5b58066'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:52.181417 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681647b753254ecca504f3fbc5b58066'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:52.188880 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1350/2689] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:57:51 2021] DELETE /identity/v3/users/681647b753254ecca504f3fbc5b58066 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:57:52.193558 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623021c-ca83-4db7-bf41-29f10a3fdbaf None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:52.194046 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623021c-ca83-4db7-bf41-29f10a3fdbaf None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:52.194692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623021c-ca83-4db7-bf41-29f10a3fdbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:52.223336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5623021c-ca83-4db7-bf41-29f10a3fdbaf None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:52.225170 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5623021c-ca83-4db7-bf41-29f10a3fdbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:52.320373 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1340/2690] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:52.355715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:52.358707 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:52.497556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf34e-8818-4bba-863c-0a43c667ad06 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:52.504176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:52.510500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:52.511084 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:52.511524 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:52.532252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:52.534171 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:52.571930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1351/2691] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:53.075524 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:53.076081 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:53.076358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:53.123649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] MFA Rules not processed for user `df8b353bcb3e40e3945c3ff2cc9a821b`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:57:53.125151 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:53.229379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1341/2692] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:57:53 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:57:53.242468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:53.248427 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:53.286903 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:53.288909 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:53.317112 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11beb-faaa-425b-abbe-e7e393e1adf0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:53.324574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:53.326144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:53.326697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:53.327237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] PATH_INFO: `/v3/projects/b209123a031643e1b7f475f8dec339bd` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:53.329255 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b209123a031643e1b7f475f8dec339bd)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:53.332380 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:53.424920 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb6bd-7749-4f5a-9bde-c60ebe2d9fca service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:53.428342 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b209123a031643e1b7f475f8dec339bd', 'request_id': 'req-c805fc0a-7fd1-413d-a495-3869d37a853e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:53.436064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b209123a031643e1b7f475f8dec339bd', 'request_id': 'req-c805fc0a-7fd1-413d-a495-3869d37a853e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:53.445052 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b209123a031643e1b7f475f8dec339bd', 'request_id': 'req-c805fc0a-7fd1-413d-a495-3869d37a853e'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:53.464353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] The token cache is being invalidate because project b209123a031643e1b7f475f8dec339bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:57:53.465189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:53.466146 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:57:53.468489 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1342/2693] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:57:53 2021] DELETE /identity/v3/projects/b209123a031643e1b7f475f8dec339bd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:57:53.599818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:53.600542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:53.600827 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:53.601103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:53.603358 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:53.750073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:53.751726 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:53.764688 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1352/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:53 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:57:58.079472 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:57:58.081159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:58.138105 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805fc0a-7fd1-413d-a495-3869d37a853e admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:57:58.141973 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:57:58.142734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:57:58.143024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:57:58.143299 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:57:58.145164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:57:58.210436 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:57:58.211977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:57:58.223213 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1343/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:57:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:01.436207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:01.437655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:01.453581 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa040-4cbd-476f-9d1d-78eb2f81d7d5 service nova] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:01.458165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:01.459040 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:01.459320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:01.459612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] PATH_INFO: `/v3/users/a7acad3852514d64be0969ac7bf19221` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:01.460813 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7acad3852514d64be0969ac7bf19221)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:01.462865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:01.510349 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7acad3852514d64be0969ac7bf19221'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.517511 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7acad3852514d64be0969ac7bf19221'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.524397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7acad3852514d64be0969ac7bf19221'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.535644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7acad3852514d64be0969ac7bf19221'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.536306 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-cf7600e1-9198-445d-9151-b5c24937cb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7acad3852514d64be0969ac7bf19221'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.542279 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1353/2696] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:01 2021] DELETE /identity/v3/users/a7acad3852514d64be0969ac7bf19221 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:01.715574 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:01.734448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb979f-0929-4251-a457-57a052bb650d service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:01.797425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:01.798287 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:01.798605 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:01.798857 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] PATH_INFO: `/v3/projects/c898dae86fd145c7bf0a0d90efe560eb` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:01.800088 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c898dae86fd145c7bf0a0d90efe560eb)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:01.802038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:01.847726 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c898dae86fd145c7bf0a0d90efe560eb', 'request_id': 'req-3130491b-b9de-4f47-b8e9-ff61f6330eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.856534 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c898dae86fd145c7bf0a0d90efe560eb', 'request_id': 'req-3130491b-b9de-4f47-b8e9-ff61f6330eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.863364 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c898dae86fd145c7bf0a0d90efe560eb', 'request_id': 'req-3130491b-b9de-4f47-b8e9-ff61f6330eb2'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.876383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] The token cache is being invalidate because project c898dae86fd145c7bf0a0d90efe560eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:01.876669 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.877289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-3130491b-b9de-4f47-b8e9-ff61f6330eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:01.878878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1344/2697] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:01 2021] DELETE /identity/v3/projects/c898dae86fd145c7bf0a0d90efe560eb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:01.885459 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:01.885995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:01.886648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:01.906612 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:01.907797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:01.965706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1354/2698] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:01.973433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:01.973723 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:01.974029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:01.993421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:01.995118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:02.002735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1345/2699] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:02.007108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.016811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4b02-8453-40ff-a594-f43021559f65 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.021366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.022008 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.022287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.022592 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.023332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:02.023636 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.025411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.040775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1355/2700] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:02.043087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.052298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11de2-4c17-442a-9ac8-8f38214cf6a3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.057473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.058162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.058396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.058697 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.059396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.061316 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.092862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1346/2701] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:02.094075 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.104793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288a47a-cb2a-4825-9fce-0a81bb189538 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.158905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.159569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.159850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.160124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.160833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.163252 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.184571 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1356/2702] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:02.188661 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.198775 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eeca4-dd30-47a2-b0b9-93096c0d53be admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.204594 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.205267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.205543 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.205815 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.206590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.208186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.219262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1347/2703] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:58:02.223391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.233958 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7f53-9627-42f3-b45f-877ec48885b6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.238562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.239215 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.239500 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.239777 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.240516 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.242273 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e47d6b-6ec4-42dc-a72f-53f785662643 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.253096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1357/2704] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:02.257252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.267000 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01b1c-f5ff-475d-a4fd-dc2ec149f517 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.271945 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.273377 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.273653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.273949 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] PATH_INFO: `/v3/projects/4c0ea8c9225b42a68752477b9b7a782d/users/465bf5ef0fd7448caddd05d5c47f9f66/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.289087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0ea8c9225b42a68752477b9b7a782d, user_id=465bf5ef0fd7448caddd05d5c47f9f66, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.291791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.304056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1348/2705] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:02 2021] PUT /identity/v3/projects/4c0ea8c9225b42a68752477b9b7a782d/users/465bf5ef0fd7448caddd05d5c47f9f66/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:02.314299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.314685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.314966 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.341780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] MFA Rules not processed for user `465bf5ef0fd7448caddd05d5c47f9f66`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:02.343230 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:02.421900 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1358/2706] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:02.423072 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.482658 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8827ec9-ca2c-4be9-ac62-87982c1908cd admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.487414 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.488069 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.488349 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.488623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.489335 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.491260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.518653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1349/2707] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:02.519845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.531613 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b96a-654c-4b81-be1c-9d2a4de563be None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.587911 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.588574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.588850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.589121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.589820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.591778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.611811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1359/2708] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:58:02.615754 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.627943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9f96-6d10-4ec5-88dd-1f7f0a7affa7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.634021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.634777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.635056 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.635328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.636058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.637672 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.648562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1350/2709] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:02.653062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.663466 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcabb2e-fe08-4784-bffa-1b6ac592b445 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.668098 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.668956 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.669232 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.669504 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] PATH_INFO: `/v3/projects/aa41ee08615f4c8da73661253fc54902/users/3858fbd086564a5cae40257de776ab5e/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.683401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa41ee08615f4c8da73661253fc54902, user_id=3858fbd086564a5cae40257de776ab5e, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.686071 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.700191 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1360/2710] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:02 2021] PUT /identity/v3/projects/aa41ee08615f4c8da73661253fc54902/users/3858fbd086564a5cae40257de776ab5e/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:02.704179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.714732 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215f9d-2f77-4b48-a084-a4eb29ecc176 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.781941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.782653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.782933 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.783204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.783947 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.785568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee6a35-40a7-46a9-aa5d-1e8aa9bdef65 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.796760 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1351/2711] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:02.800968 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.811284 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f011da-5aec-430b-a1e4-615bbcd62509 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:02.815980 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:02.816916 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.817194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.817468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] PATH_INFO: `/v3/projects/aa41ee08615f4c8da73661253fc54902/users/3858fbd086564a5cae40257de776ab5e/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.819995 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa41ee08615f4c8da73661253fc54902, user_id=3858fbd086564a5cae40257de776ab5e, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:02.822678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:02.836583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1361/2712] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:02 2021] PUT /identity/v3/projects/aa41ee08615f4c8da73661253fc54902/users/3858fbd086564a5cae40257de776ab5e/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:02.847411 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:02.847718 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:02.847996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:02.874087 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] MFA Rules not processed for user `3858fbd086564a5cae40257de776ab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:02.875330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:02.948955 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1352/2713] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:02 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:02.959363 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:02.961031 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:03.017147 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f57e-d898-44cb-a4b7-42b45b018b29 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:03.020795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:03.021432 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:03.021713 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:03.021988 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:03.030976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:03.032402 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:03.042661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1362/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:02 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:03.111164 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:03.121599 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814b4c-3cf5-45f7-8d83-10587fc5673b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:03.125549 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:03.126192 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:03.126468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:03.126773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:03.181777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:03.183278 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662e8a9-6289-4676-b0e3-68ac991025a8 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:03.192642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1353/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:03 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:05.854192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:05.914380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143098-bd83-4f29-9b38-e72cd1a07153 service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:05.918922 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:05.919769 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:05.920049 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:05.920320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] PATH_INFO: `/v3/users/465bf5ef0fd7448caddd05d5c47f9f66` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:05.921508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=465bf5ef0fd7448caddd05d5c47f9f66)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:05.923474 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:05.967877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465bf5ef0fd7448caddd05d5c47f9f66'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:05.975371 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465bf5ef0fd7448caddd05d5c47f9f66'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:05.983750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465bf5ef0fd7448caddd05d5c47f9f66'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:05.995594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465bf5ef0fd7448caddd05d5c47f9f66'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:05.996320 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465bf5ef0fd7448caddd05d5c47f9f66'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.002085 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1363/2716] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:05 2021] DELETE /identity/v3/users/465bf5ef0fd7448caddd05d5c47f9f66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:06.006562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:06.007006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:06.007117 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:06.024882 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:06.026086 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:06.089267 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1354/2717] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:58:06.096162 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:06.097558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:06.153514 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c3da-f10e-424b-9912-6e6e246bca8a admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:06.157743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:06.158389 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:06.158708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:06.158982 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:06.168706 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:06.170129 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:06.179254 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1364/2718] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:06.459232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:06.460736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:06.473856 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab30bab-81b8-4a2c-82b2-7ab2318bc4dd None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:06.479091 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:06.479960 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:06.480243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:06.480516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] PATH_INFO: `/v3/projects/4c0ea8c9225b42a68752477b9b7a782d` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:06.481743 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0ea8c9225b42a68752477b9b7a782d)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:06.483994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:06.529968 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0ea8c9225b42a68752477b9b7a782d', 'request_id': 'req-1beba5e3-cb4d-46f6-8bd3-960c4824464b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.535043 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0ea8c9225b42a68752477b9b7a782d', 'request_id': 'req-1beba5e3-cb4d-46f6-8bd3-960c4824464b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.541417 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0ea8c9225b42a68752477b9b7a782d', 'request_id': 'req-1beba5e3-cb4d-46f6-8bd3-960c4824464b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.553292 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] The token cache is being invalidate because project 4c0ea8c9225b42a68752477b9b7a782d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:06.553582 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.554199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.555757 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1355/2719] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:06 2021] DELETE /identity/v3/projects/4c0ea8c9225b42a68752477b9b7a782d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:06.560246 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:06.573356 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad90a0-706e-4590-bcac-fa8acd31019a service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:06.628447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:06.629343 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:06.629620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:06.629890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] PATH_INFO: `/v3/users/3858fbd086564a5cae40257de776ab5e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:06.631286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3858fbd086564a5cae40257de776ab5e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:06.633955 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:06.685430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3858fbd086564a5cae40257de776ab5e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.692632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3858fbd086564a5cae40257de776ab5e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.701058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3858fbd086564a5cae40257de776ab5e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.712793 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3858fbd086564a5cae40257de776ab5e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.713455 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e1caeca0-2aff-46f0-a1ba-8c2209af9a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3858fbd086564a5cae40257de776ab5e'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:06.721130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1365/2720] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:06 2021] DELETE /identity/v3/users/3858fbd086564a5cae40257de776ab5e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:07.005800 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.007333 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:07.021921 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beba5e3-cb4d-46f6-8bd3-960c4824464b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.082486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.083295 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.083579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.084139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] PATH_INFO: `/v3/projects/aa41ee08615f4c8da73661253fc54902` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.085369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa41ee08615f4c8da73661253fc54902)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.087343 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.133830 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa41ee08615f4c8da73661253fc54902', 'request_id': 'req-523cf89d-175c-41f9-9e0d-4ba50dee13bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:07.139062 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa41ee08615f4c8da73661253fc54902', 'request_id': 'req-523cf89d-175c-41f9-9e0d-4ba50dee13bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:07.145274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa41ee08615f4c8da73661253fc54902', 'request_id': 'req-523cf89d-175c-41f9-9e0d-4ba50dee13bd'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:07.157258 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] The token cache is being invalidate because project aa41ee08615f4c8da73661253fc54902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:07.157545 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:07.158159 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-523cf89d-175c-41f9-9e0d-4ba50dee13bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:07.159719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1356/2721] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:07 2021] DELETE /identity/v3/projects/aa41ee08615f4c8da73661253fc54902 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:07.165870 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.166369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.166469 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.184701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:07.185901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:07.241332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1366/2722] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:07.250190 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.250476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.250786 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.268418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:07.269602 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:07.277309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1357/2723] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:07.281310 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.290946 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87405af-f1a2-4abd-bd08-4de270180af9 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.295387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.296022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.296303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.296575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.297298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:07.297599 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.299200 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.310710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1367/2724] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:07.314776 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.323617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30f84-b446-4567-8974-34c6d5827d92 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.328205 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.328834 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.329114 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.329385 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.330075 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.331992 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.356581 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1358/2725] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:07.360597 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.371145 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7b617-54c3-4a76-a229-6b1bb2143f5d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.422868 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.423515 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.423798 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.424073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.424770 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.426682 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.445155 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1368/2726] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/users => generated 291 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:58:07.449379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.459513 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e455-9e27-44ad-be16-10356534ad05 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.464935 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.465588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.465867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.466140 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.466943 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.468537 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.480763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1359/2727] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:07.484833 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.494869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31595-b5dc-414f-b471-86e60f920f73 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.499674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.500397 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.500689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.500977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.501830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.503434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d559917-bcab-4eac-95af-a638215890ae admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.513360 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1369/2728] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:07.517327 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.527615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bf873-51c6-41a7-a4fb-d5708c15a29b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.532311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.533162 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.533440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.533714 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] PATH_INFO: `/v3/projects/866d40427e1f4d40ad2a1ccc1c475f5b/users/4239f008c7e14ff8a57c43227d3741e7/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.548054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=866d40427e1f4d40ad2a1ccc1c475f5b, user_id=4239f008c7e14ff8a57c43227d3741e7, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.550716 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.562418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1360/2729] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:07 2021] PUT /identity/v3/projects/866d40427e1f4d40ad2a1ccc1c475f5b/users/4239f008c7e14ff8a57c43227d3741e7/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:07.572312 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.572594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.572869 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.598322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] MFA Rules not processed for user `4239f008c7e14ff8a57c43227d3741e7`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:07.599553 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:07.667606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1370/2730] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:07.672100 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.729788 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec32cc-3873-4d70-b005-04a340a2d81b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.734358 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.735051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.735324 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.735590 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.736271 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.738144 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.765481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1361/2731] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:07.766658 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.777801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c511d5-8d67-4230-98b6-5207c8cf2d7f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.830477 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.831164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.831440 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.831708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.832409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.834282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.854583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1371/2732] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:07 2021] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:07.856617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.866495 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0de85-bf57-4766-8ac2-598cea664878 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.871407 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.872102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.872379 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.872654 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.873394 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.875097 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.887015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1362/2733] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:07.891087 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.901229 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a712d2-e7d8-4dde-b9de-7f862d3bb1e6 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:07.906114 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:07.907006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:07.907282 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:07.907552 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] PATH_INFO: `/v3/projects/8028f80d7b994cd992edfbc515a445b5/users/b5dea1e4dc2f458199241c8e8c071fc0/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:07.922929 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8028f80d7b994cd992edfbc515a445b5, user_id=b5dea1e4dc2f458199241c8e8c071fc0, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:07.925489 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:07.941802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1372/2734] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:07 2021] PUT /identity/v3/projects/8028f80d7b994cd992edfbc515a445b5/users/b5dea1e4dc2f458199241c8e8c071fc0/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:07.943037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:07.953735 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda55d-afab-4fe1-ad89-63625a6c965b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:08.015858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:08.016624 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.017006 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.017378 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.018210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:08.019928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124530ee-5910-45a3-8c2c-2dd1a6166d27 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:08.030874 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1363/2735] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:08.035890 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:08.046228 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c83ffc-4205-48a0-82cf-1613504a22fd admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:08.051112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:08.052070 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.052839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.052839 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] PATH_INFO: `/v3/projects/8028f80d7b994cd992edfbc515a445b5/users/b5dea1e4dc2f458199241c8e8c071fc0/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.054635 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8028f80d7b994cd992edfbc515a445b5, user_id=b5dea1e4dc2f458199241c8e8c071fc0, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:08.057287 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:08.067541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1373/2736] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:08 2021] PUT /identity/v3/projects/8028f80d7b994cd992edfbc515a445b5/users/b5dea1e4dc2f458199241c8e8c071fc0/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:08.079822 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.080111 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.080388 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.106986 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] MFA Rules not processed for user `b5dea1e4dc2f458199241c8e8c071fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:08.108241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:08.181931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1364/2737] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:08 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:08.192042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:08.193754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:08.247161 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d6839-19a5-48d3-b37b-a2d3260da1f3 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:08.250750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:08.251369 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.251648 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.251921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.261104 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:08.262506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49aa7-4b1b-4357-92b2-356399b9fea7 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:08.271520 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1374/2738] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:08 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:08.591639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:08.650348 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a4ec1-b1b0-4697-ae87-fec53fd2a1f5 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:08.654808 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:08.655651 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.655928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.656200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] PATH_INFO: `/v3/users/4239f008c7e14ff8a57c43227d3741e7` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.657404 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4239f008c7e14ff8a57c43227d3741e7)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:08.659336 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:08.701789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4239f008c7e14ff8a57c43227d3741e7'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:08.712623 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4239f008c7e14ff8a57c43227d3741e7'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:08.719003 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4239f008c7e14ff8a57c43227d3741e7'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:08.719644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4239f008c7e14ff8a57c43227d3741e7'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:08.720241 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4239f008c7e14ff8a57c43227d3741e7'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:08.732851 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1365/2739] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:08 2021] DELETE /identity/v3/users/4239f008c7e14ff8a57c43227d3741e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:08.737439 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.737725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.738027 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.756066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:08.757308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:08.815249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1375/2740] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:08.824996 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:08.826354 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:08.879907 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18c32f-087e-4453-af1e-7fc8d73cf346 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:08.883570 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:08.884199 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:08.884475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:08.884746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:08.893375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:08.894807 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:08.904319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1366/2741] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:09.159068 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:09.160485 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:09.173509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099096e-f458-4536-9c0d-5c4e2d4bea72 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:09.178112 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:09.178994 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.179373 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.179651 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] PATH_INFO: `/v3/projects/866d40427e1f4d40ad2a1ccc1c475f5b` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.181350 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=866d40427e1f4d40ad2a1ccc1c475f5b)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:09.184283 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:09.238256 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866d40427e1f4d40ad2a1ccc1c475f5b', 'request_id': 'req-dcf6d962-973e-4dc9-8749-8db9ab24b69c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.242593 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866d40427e1f4d40ad2a1ccc1c475f5b', 'request_id': 'req-dcf6d962-973e-4dc9-8749-8db9ab24b69c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.250670 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866d40427e1f4d40ad2a1ccc1c475f5b', 'request_id': 'req-dcf6d962-973e-4dc9-8749-8db9ab24b69c'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.262527 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] The token cache is being invalidate because project 866d40427e1f4d40ad2a1ccc1c475f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:09.262842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.263462 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.264978 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1376/2742] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:09 2021] DELETE /identity/v3/projects/866d40427e1f4d40ad2a1ccc1c475f5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:09.268867 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:09.278298 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888337-687d-4e14-8403-3bb108438235 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:09.330269 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:09.331153 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.331667 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.331892 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] PATH_INFO: `/v3/users/b5dea1e4dc2f458199241c8e8c071fc0` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.333110 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5dea1e4dc2f458199241c8e8c071fc0)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:09.335044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:09.377083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5dea1e4dc2f458199241c8e8c071fc0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.388080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5dea1e4dc2f458199241c8e8c071fc0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.394473 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5dea1e4dc2f458199241c8e8c071fc0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.395136 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5dea1e4dc2f458199241c8e8c071fc0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.395725 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-899b190f-07d4-48bc-8fd4-9a90a53333e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5dea1e4dc2f458199241c8e8c071fc0'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.407619 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1367/2743] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:09 2021] DELETE /identity/v3/users/b5dea1e4dc2f458199241c8e8c071fc0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:09.663294 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:09.664693 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:09.681109 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d962-973e-4dc9-8749-8db9ab24b69c admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:09.735517 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:09.736368 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.736647 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.736921 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] PATH_INFO: `/v3/projects/8028f80d7b994cd992edfbc515a445b5` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.738160 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8028f80d7b994cd992edfbc515a445b5)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:09.740124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:09.783521 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8028f80d7b994cd992edfbc515a445b5', 'request_id': 'req-98bc62cf-6914-4492-ae69-ecf7d890a8fa'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.788564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8028f80d7b994cd992edfbc515a445b5', 'request_id': 'req-98bc62cf-6914-4492-ae69-ecf7d890a8fa'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.795715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8028f80d7b994cd992edfbc515a445b5', 'request_id': 'req-98bc62cf-6914-4492-ae69-ecf7d890a8fa'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.806036 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] The token cache is being invalidate because project 8028f80d7b994cd992edfbc515a445b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:09.806317 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.806976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-98bc62cf-6914-4492-ae69-ecf7d890a8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:09.808468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1377/2744] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:09 2021] DELETE /identity/v3/projects/8028f80d7b994cd992edfbc515a445b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:09.814041 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.814326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.814631 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.831468 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:09.832649 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:09.888645 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1368/2745] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:09.896463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.896743 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.897013 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.915626 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:09.916802 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:09.924488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1378/2746] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:09.928441 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:09.937609 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b31b-6402-4303-90d0-83c86642cfb0 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:09.942095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:09.942759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.943037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.943308 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.944030 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:09.944331 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:09.945899 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:09.956767 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1369/2747] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:09.961002 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:09.970280 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86173f9f-c499-47ef-a338-6a2f4eb3c34f None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:09.974928 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:09.975565 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:09.975846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:09.976120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:09.976825 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:09.979301 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.007120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1379/2748] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:09 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:10.008244 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:10.020942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abff5f-74f6-42b6-a596-b91baf067d88 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:10.074102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:10.074779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.075060 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.075339 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.076020 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:10.078021 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.097510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1370/2749] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:10 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:10.101525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:10.111325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bd89e-7082-4225-9e28-a9d2c0c3c05d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:10.115775 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:10.116416 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.116692 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.116965 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.117686 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:10.119563 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.129434 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1380/2750] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:10.133171 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:10.143557 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5553e-8663-4da6-9fda-dc5ddae63ba1 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:10.148139 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:10.148773 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.149048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.149875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.150630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:10.152197 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259161af-a414-4ee8-a522-293a6afd0edc admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.161587 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1371/2751] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:10.165579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:10.175266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab1fa-0c4c-4808-a803-2069128acb20 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:10.179823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:10.180746 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.181026 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.181302 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] PATH_INFO: `/v3/projects/c40c425e37954a9fba0bb9752a69a50d/users/2094fe7fb0ce434ea23b1cc1c4620694/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.195163 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40c425e37954a9fba0bb9752a69a50d, user_id=2094fe7fb0ce434ea23b1cc1c4620694, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:10.198298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.210510 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1381/2752] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:10 2021] PUT /identity/v3/projects/c40c425e37954a9fba0bb9752a69a50d/users/2094fe7fb0ce434ea23b1cc1c4620694/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:10.222620 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.222978 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.223252 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.251037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] MFA Rules not processed for user `2094fe7fb0ce434ea23b1cc1c4620694`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:10.252235 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:10.313862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1372/2753] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:10 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:10.324061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:10.325782 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:10.380558 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757b89-422b-45e0-bedd-f9c5274ebbb7 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:10.384815 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:10.385447 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:10.385725 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:10.385997 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:10.393951 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:10.395404 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f855f-c610-4487-96c3-3473f0901050 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:10.403844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1382/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:10 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:20.735529 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:20.797206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faaab6-63ad-4253-bd3d-50834addcec3 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:20.801759 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:20.802664 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:20.802942 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:20.803211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] PATH_INFO: `/v3/users/2094fe7fb0ce434ea23b1cc1c4620694` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:20.804462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2094fe7fb0ce434ea23b1cc1c4620694)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:20.807002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:20.855138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2094fe7fb0ce434ea23b1cc1c4620694'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:20.867636 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2094fe7fb0ce434ea23b1cc1c4620694'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:20.876416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2094fe7fb0ce434ea23b1cc1c4620694'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:20.877095 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2094fe7fb0ce434ea23b1cc1c4620694'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:20.877734 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2094fe7fb0ce434ea23b1cc1c4620694'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:20.889586 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1373/2755] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:20 2021] DELETE /identity/v3/users/2094fe7fb0ce434ea23b1cc1c4620694 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:20.894625 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:20.895194 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:20.895334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:20.913728 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:20.915620 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:20.971495 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1383/2756] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:20.981883 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:20.983293 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.037346 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c2a8-4e56-4c6b-8afb-570a9fb22b81 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.041606 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.042242 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.042519 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.042825 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.051496 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.052916 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f809-77f4-4922-8686-7dab58c43775 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.062059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1374/2757] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:21.314977 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.316380 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.329733 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb85c-cbb6-4c2c-926e-882f98ff1771 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.334322 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.335719 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.336169 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.336454 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] PATH_INFO: `/v3/projects/c40c425e37954a9fba0bb9752a69a50d` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.338244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40c425e37954a9fba0bb9752a69a50d)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.340182 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.383952 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40c425e37954a9fba0bb9752a69a50d', 'request_id': 'req-e19d3e24-bf2a-47fc-96d2-5acff35b1689'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:21.389097 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40c425e37954a9fba0bb9752a69a50d', 'request_id': 'req-e19d3e24-bf2a-47fc-96d2-5acff35b1689'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:21.395949 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40c425e37954a9fba0bb9752a69a50d', 'request_id': 'req-e19d3e24-bf2a-47fc-96d2-5acff35b1689'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:21.406897 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] The token cache is being invalidate because project c40c425e37954a9fba0bb9752a69a50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:21.407176 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:21.407785 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-e19d3e24-bf2a-47fc-96d2-5acff35b1689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:21.409261 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1384/2758] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:21 2021] DELETE /identity/v3/projects/c40c425e37954a9fba0bb9752a69a50d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:21.414958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.415338 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.415615 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.432925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:21.434121 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.488961 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1375/2759] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:21.497072 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.497299 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.497574 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.515664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:21.516851 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.525192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1385/2760] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:21.529090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.538289 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714778c7-c45f-47b4-bffa-3cd81d6d947b None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.542905 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.543538 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.543814 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.544083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.544804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:21.545106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.546705 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.557579 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1376/2761] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:21.561564 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.570438 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5594-2b79-4538-bf08-15cddbb674bf None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.575572 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.576201 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.576509 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.576784 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.577480 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.579398 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.604126 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1386/2762] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:21.607875 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.617736 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2126b-c9f8-4570-a8b3-217e65b0f89b admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.679547 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.680206 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.680994 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.681268 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.682039 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.683982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.702984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1377/2763] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:58:21.707245 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.717164 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992c5fa-b46c-4ed2-809a-76d599368441 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.721950 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.722685 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.722969 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.723244 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.723976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.725575 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.736319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1387/2764] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:21.739803 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.750630 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb3cb-5dcc-49bc-aea2-2cfebcf441b9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.755502 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.756174 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.756449 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.756719 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.757442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.759641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8f414-7aac-42b3-88aa-44a077cf16d4 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.772396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1378/2765] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 18:58:21.773603 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.783930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca55a83-5034-43e4-bc8d-34a88839915b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:21.788619 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:21.789473 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.789773 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.790043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] PATH_INFO: `/v3/projects/57c9901760944232b1b3032aac464ba8/users/92c4eac72f6343f08127208ac1ec363f/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.804472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c9901760944232b1b3032aac464ba8, user_id=92c4eac72f6343f08127208ac1ec363f, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:21.807664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ef82a-f230-491d-8756-4fcdb9065e12 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:21.820526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1388/2766] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:21 2021] PUT /identity/v3/projects/57c9901760944232b1b3032aac464ba8/users/92c4eac72f6343f08127208ac1ec363f/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:21.830797 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.830946 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:21.831108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.831224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:21.831366 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.831500 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:21.848562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] MFA Rules not processed for user `afdb1609b19c483488024719232bdd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:21.849808 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.856789 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] MFA Rules not processed for user `92c4eac72f6343f08127208ac1ec363f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:21.857950 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:21.902621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1389/2767] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:21.920567 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1379/2768] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:21 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:21.949401 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:21.950918 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.010761 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa1e2-5ace-4b45-ab4f-9d68319f97e7 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.014354 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.015028 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.015309 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.015702 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.024131 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.025557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7fe4-0bbd-4858-a7f6-3227443d6af2 service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.034569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1390/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:21 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:22.048479 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:22.106560 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5f063-84ea-417b-869b-d408318aacc2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.111204 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.112055 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.112328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.112595 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] PATH_INFO: `/v3/users/92c4eac72f6343f08127208ac1ec363f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.113792 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c4eac72f6343f08127208ac1ec363f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.115713 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.160838 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c4eac72f6343f08127208ac1ec363f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.172498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c4eac72f6343f08127208ac1ec363f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.178925 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c4eac72f6343f08127208ac1ec363f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.179641 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c4eac72f6343f08127208ac1ec363f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.180260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c4eac72f6343f08127208ac1ec363f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.193382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1380/2770] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:22 2021] DELETE /identity/v3/users/92c4eac72f6343f08127208ac1ec363f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:22.197901 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.198193 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.198499 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.204632 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:22.206080 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.215867 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:22.217046 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.261456 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a872820-b995-4e5f-977d-20a0e6e15540 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.265098 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.265763 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.266048 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.266317 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.268127 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.272266 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1391/2771] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:22.277666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.279166 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.282103 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:22.287526 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1381/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:58:22.291912 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2afc-17ac-4181-88fe-4874364043f8 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.295642 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.296278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.296556 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.296829 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.306488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.307948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758df43-36ea-45f7-b640-db7275bd8ab4 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.317296 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1392/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 18:58:22.702860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:22.704260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.722038 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f69c-95c2-4493-9a03-8330ef6c0255 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.736059 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.736924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.737262 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.737593 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] PATH_INFO: `/v3/projects/57c9901760944232b1b3032aac464ba8` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.738779 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c9901760944232b1b3032aac464ba8)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.740820 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.788307 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c9901760944232b1b3032aac464ba8', 'request_id': 'req-c4c51831-07e2-4287-8bee-d49660641c7c'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.794219 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c9901760944232b1b3032aac464ba8', 'request_id': 'req-c4c51831-07e2-4287-8bee-d49660641c7c'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.801562 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c9901760944232b1b3032aac464ba8', 'request_id': 'req-c4c51831-07e2-4287-8bee-d49660641c7c'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.814777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] The token cache is being invalidate because project 57c9901760944232b1b3032aac464ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:22.815084 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.815752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-c4c51831-07e2-4287-8bee-d49660641c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:22.817274 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1382/2774] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:22 2021] DELETE /identity/v3/projects/57c9901760944232b1b3032aac464ba8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:22.823715 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.824073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.824411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.844262 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:22.845583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.908579 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1393/2775] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:22.917210 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.917516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.917791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.937564 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:22.939049 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:22.947951 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1383/2776] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:22.953583 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:22.967889 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5b600-3306-42c0-bb00-513c371576ec None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:22.972639 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:22.973292 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:22.973569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:22.973846 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] PATH_INFO: `/v3/domains` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:22.974610 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:22.974914 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:22.976616 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:22.993615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1394/2777] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:22.995101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.004443 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2074b-442e-4b48-8a08-4fe9c44a8b04 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.009752 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.010475 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.010860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.011202 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.011988 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.013926 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.039427 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1384/2778] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:22 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:58:23.043828 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.054750 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9866-c932-4019-a53a-ddc477a0d28f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.109370 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.110038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.110321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.110606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.111501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.113664 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.134662 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1395/2779] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:23 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:23.139015 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.149130 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49837a-2950-4017-be14-b933921bbce7 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.153679 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.154319 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.154629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.154897 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.155617 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.157183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.170995 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1385/2780] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:23.172321 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.182588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8aac-e293-4ee3-85fe-51687b22980d admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.187124 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.187768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.188045 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.188337 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.189043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.190704 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b10b24-9452-48d6-829b-f5569655b133 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.202121 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1396/2781] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:23.206179 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.215958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577ab83-1e62-4df8-a3a5-bb985544a9db admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.220638 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.221501 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] REQUEST_METHOD: `PUT` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.221781 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.222053 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] PATH_INFO: `/v3/projects/ca44084668dd4baa851396ab6a82a94e/users/4ea85027056a48eb8177bbf840d8dd1f/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.237090 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca44084668dd4baa851396ab6a82a94e, user_id=4ea85027056a48eb8177bbf840d8dd1f, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.239771 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.255860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1386/2782] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:23 2021] PUT /identity/v3/projects/ca44084668dd4baa851396ab6a82a94e/users/4ea85027056a48eb8177bbf840d8dd1f/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:23.267710 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.268044 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.268325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.294207 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] MFA Rules not processed for user `4ea85027056a48eb8177bbf840d8dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:23.295382 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:23.364409 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1397/2783] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:23 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:58:23.369634 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.429527 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d56c3-a00f-4ceb-a090-b03496eb0265 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.434682 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.435326 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.435603 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.435873 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.436572 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.438442 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.462693 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1387/2784] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:23 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:23.466862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.477088 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa019-8b69-4b3b-902e-e785f53009c2 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.529818 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.530468 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.530778 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.531053 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] PATH_INFO: `/v3/users` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.531768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.533655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.552687 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1398/2785] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:23 2021] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:23.557237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.567156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbd224-7e12-4352-aace-deaca9624da9 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.571673 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.572309 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.572588 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.572858 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.573583 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.575387 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.586383 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1388/2786] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:23.590862 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.601470 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df293040-8b34-4769-88de-af57e6eeed3f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.606525 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.607419 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.607701 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.607976 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] PATH_INFO: `/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8/users/dabf998b76cf46ca99ea8760c8af2804/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.624009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2f0edb9bc14cfa8f42aae1ecf70cc8, user_id=dabf998b76cf46ca99ea8760c8af2804, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.626795 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.641249 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1399/2787] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:23 2021] PUT /identity/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8/users/dabf998b76cf46ca99ea8760c8af2804/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:23.645028 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.655013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2fdc-e99a-4b2e-97ed-20d5aa526950 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.712520 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.713419 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.713777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.714122 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.714976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.716796 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e54267-fb74-4212-ab08-3ca49c79b383 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.729129 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1389/2788] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:23 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:23.733172 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.745387 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827434-6723-4e37-80af-d809b30b174b admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.751117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.752000 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.752278 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.752554 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] PATH_INFO: `/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8/users/dabf998b76cf46ca99ea8760c8af2804/roles/1d454c4ebcdf418baa5a3094d4e4012c` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.754623 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2f0edb9bc14cfa8f42aae1ecf70cc8, user_id=dabf998b76cf46ca99ea8760c8af2804, role_id=1d454c4ebcdf418baa5a3094d4e4012c)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:23.757319 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:23.782052 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1400/2789] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:23 2021] PUT /identity/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8/users/dabf998b76cf46ca99ea8760c8af2804/roles/1d454c4ebcdf418baa5a3094d4e4012c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:23.785871 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.786303 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.786431 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:23.815366 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] MFA Rules not processed for user `dabf998b76cf46ca99ea8760c8af2804`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:23.816692 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:23.889175 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1390/2790] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:23 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 18:58:23.898774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:23.901661 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:23.966708 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d144-f7c2-48ab-86da-6697bd6ccec0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:23.971822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:23.972472 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:23.972820 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:23.973014 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:24.039653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:24.041638 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc1669-d9c3-471b-b32f-321be5fd31ff service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:24.051801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1401/2791] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:23 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:26.612666 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:26.677563 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56ac7f-3140-4e2a-beb8-59e15deb5a14 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:26.682005 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:26.682886 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:26.683165 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:26.683429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] PATH_INFO: `/v3/users/4ea85027056a48eb8177bbf840d8dd1f` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:26.684642 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea85027056a48eb8177bbf840d8dd1f)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:26.686571 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:26.730001 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea85027056a48eb8177bbf840d8dd1f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:26.741155 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea85027056a48eb8177bbf840d8dd1f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:26.748064 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea85027056a48eb8177bbf840d8dd1f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:26.748727 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea85027056a48eb8177bbf840d8dd1f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:26.749321 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea85027056a48eb8177bbf840d8dd1f'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:26.763051 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1391/2792] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:26 2021] DELETE /identity/v3/users/4ea85027056a48eb8177bbf840d8dd1f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 18:58:26.767594 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:26.768073 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:26.768226 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:26.785484 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:26.786683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:26.846861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1402/2793] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:26.857011 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:26.858416 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:26.913168 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ae4c3-39c7-4593-af6c-6b261d7deb5a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:26.916870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:26.917498 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:26.917780 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:26.918058 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:26.926953 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:26.928418 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:26.938023 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1392/2794] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:27.200022 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:27.201632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:27.216910 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91a3e0-d7c2-45af-9cbb-28ed9d4f6d34 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:27.221630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:27.222615 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.222780 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.223078 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] PATH_INFO: `/v3/projects/ca44084668dd4baa851396ab6a82a94e` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.224325 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca44084668dd4baa851396ab6a82a94e)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:27.226260 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:27.272095 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca44084668dd4baa851396ab6a82a94e', 'request_id': 'req-6c24a6db-05ec-4cdf-902d-75729698818f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.277224 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca44084668dd4baa851396ab6a82a94e', 'request_id': 'req-6c24a6db-05ec-4cdf-902d-75729698818f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.283659 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca44084668dd4baa851396ab6a82a94e', 'request_id': 'req-6c24a6db-05ec-4cdf-902d-75729698818f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.295255 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] The token cache is being invalidate because project ca44084668dd4baa851396ab6a82a94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:27.295542 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.296156 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.297669 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1403/2795] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:27 2021] DELETE /identity/v3/projects/ca44084668dd4baa851396ab6a82a94e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:27.301578 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:27.311454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b5cad-a98b-47f1-b31a-19c2b0121f06 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:27.363312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:27.364160 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.364438 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.364712 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] PATH_INFO: `/v3/users/dabf998b76cf46ca99ea8760c8af2804` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.365894 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabf998b76cf46ca99ea8760c8af2804)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:27.368686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:27.411247 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabf998b76cf46ca99ea8760c8af2804'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.422793 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabf998b76cf46ca99ea8760c8af2804'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.429330 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabf998b76cf46ca99ea8760c8af2804'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.430089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabf998b76cf46ca99ea8760c8af2804'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.431265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-aa82f610-5303-4d20-9808-abe14559ead7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabf998b76cf46ca99ea8760c8af2804'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.443476 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1393/2796] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:58:27 2021] DELETE /identity/v3/users/dabf998b76cf46ca99ea8760c8af2804 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:27.704736 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:27.706242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:27.720430 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a6db-05ec-4cdf-902d-75729698818f admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:27.775549 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:27.776445 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.776723 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.776998 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] PATH_INFO: `/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.778241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2f0edb9bc14cfa8f42aae1ecf70cc8)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:27.780177 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:27.823557 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2f0edb9bc14cfa8f42aae1ecf70cc8', 'request_id': 'req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.828673 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2f0edb9bc14cfa8f42aae1ecf70cc8', 'request_id': 'req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.835569 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2f0edb9bc14cfa8f42aae1ecf70cc8', 'request_id': 'req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.846203 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] The token cache is being invalidate because project 2e2f0edb9bc14cfa8f42aae1ecf70cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:58:27.846487 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.847127 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-4d0dd8c3-f384-4710-8e0c-67028a4e1b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:58:27.848607 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1404/2797] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:58:27 2021] DELETE /identity/v3/projects/2e2f0edb9bc14cfa8f42aae1ecf70cc8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:27.854841 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.855322 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.855454 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.872864 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:27.874157 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:27.929607 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1394/2798] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:27.938461 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.938801 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.939077 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.956844 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:27.957975 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:27.966298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1405/2799] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:27.970481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:27.981844 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05244ce-75ce-430f-9876-323817a32c58 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:27.986470 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:27.987167 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:27.987448 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:27.987724 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:27.988461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=109152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 18:58:27.988768 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:27.990353 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.001971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1395/2800] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Oct 18 18:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 18:58:28.006187 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.015689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99cfe-8609-4bed-847f-e945d8f55220 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.020242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.020872 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.021146 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.021420 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.022115 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.024591 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.048383 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1406/2801] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Oct 18 18:58:28 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 18:58:28.052486 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.062037 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7844c-e10f-458f-94f6-cfc177f0a1ab admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.114982 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.115633 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.115908 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.116176 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] PATH_INFO: `/v3/users` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.116862 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.119044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.137474 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1396/2802] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Oct 18 18:58:28 2021] POST /identity/v3/users => generated 282 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 18:58:28.141562 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.152451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26272c69-4a06-435f-aaff-fd3946e2efa8 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.157009 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.157644 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.157924 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.158188 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] PATH_INFO: `/v3/roles` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.158947 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.160665 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.170464 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1407/2803] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:28.174243 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.183971 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba13cc-9bbe-4478-b1f2-9dbeb90271c6 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.188461 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.189101 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.189376 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.189644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] PATH_INFO: `/v3/roles` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.190402 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.192016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae959-892d-47c5-87f3-437e9fc93631 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.202432 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1397/2804] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Oct 18 18:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 18:58:28.206598 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.216990 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665258-6724-4928-b5da-3820ca87d202 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.221491 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.222342 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] REQUEST_METHOD: `PUT` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.222655 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.222930 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] PATH_INFO: `/v3/projects/879a947d8c564526a5f2d17fdafbe1cb/users/ea7e48e2b25e417d9b07ea645045183f/roles/08471874b3754abaaf1e0e0228dc34d1` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.237192 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879a947d8c564526a5f2d17fdafbe1cb, user_id=ea7e48e2b25e417d9b07ea645045183f, role_id=08471874b3754abaaf1e0e0228dc34d1)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.239845 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.252529 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1408/2805] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Oct 18 18:58:28 2021] PUT /identity/v3/projects/879a947d8c564526a5f2d17fdafbe1cb/users/ea7e48e2b25e417d9b07ea645045183f/roles/08471874b3754abaaf1e0e0228dc34d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:58:28.263106 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.263421 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.263700 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.289220 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] MFA Rules not processed for user `ea7e48e2b25e417d9b07ea645045183f`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:58:28.290412 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:28.349452 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1398/2806] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:58:28 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:58:28.360024 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:28.361675 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:28.415811 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88998cc-1af9-48d1-8d0b-f511227bd339 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:28.419501 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:28.420130 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:28.420413 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:28.420689 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:28.428630 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:28.430043 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:28.438463 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1409/2807] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:28 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:58:41.948974 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:58:41.950835 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:42.012079 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cda2e-33c7-486e-bccd-47b42434d2ca None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:58:42.016044 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:58:42.016685 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:58:42.016958 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:58:42.017257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:58:42.019360 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:58:42.089440 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:58:42.091183 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39735-73a7-4037-98fb-66ce5a589616 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:58:42.102134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1399/2808] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:58:41 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:59:11.343926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:59:11.444760 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f38f6-d2f5-4233-9739-7a375503779d service cinder] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:59:11.449656 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:59:11.450653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:59:11.450944 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:59:11.451220 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] PATH_INFO: `/v3/users/ea7e48e2b25e417d9b07ea645045183f` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:59:11.452449 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7e48e2b25e417d9b07ea645045183f)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:59:11.454390 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:59:11.499632 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7e48e2b25e417d9b07ea645045183f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:11.506450 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7e48e2b25e417d9b07ea645045183f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:11.512926 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7e48e2b25e417d9b07ea645045183f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:11.523683 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7e48e2b25e417d9b07ea645045183f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:11.524298 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7e48e2b25e417d9b07ea645045183f'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:11.530038 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1410/2809] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 18:59:11 2021] DELETE /identity/v3/users/ea7e48e2b25e417d9b07ea645045183f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:59:11.534601 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:59:11.535103 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:59:11.535224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:59:11.579989 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] MFA Rules not processed for user `ccbaff1ca24443ce904c9dbb2942c081`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 18:59:11.581118 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:59:11.636013 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1400/2810] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 18:59:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 18:59:11.645653 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:59:11.647058 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:59:11.734238 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56cd3e-cbe9-4222-9a25-cba7b10ba671 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:59:11.737823 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:59:11.738448 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:59:11.738754 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:59:11.739029 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:59:11.748822 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:59:11.750242 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:59:11.759453 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1411/2811] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:59:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:59:12.008433 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:59:12.009854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:59:12.021481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4b279-8182-4cd0-a658-14ca1b5141e2 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:59:12.026804 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:59:12.027655 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:59:12.027931 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:59:12.028200 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] PATH_INFO: `/v3/projects/879a947d8c564526a5f2d17fdafbe1cb` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:59:12.029375 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879a947d8c564526a5f2d17fdafbe1cb)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:59:12.031530 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:59:12.075029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879a947d8c564526a5f2d17fdafbe1cb', 'request_id': 'req-f7829fe9-8c20-4edb-acb7-99f14b87b190'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:12.080291 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879a947d8c564526a5f2d17fdafbe1cb', 'request_id': 'req-f7829fe9-8c20-4edb-acb7-99f14b87b190'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:12.086083 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879a947d8c564526a5f2d17fdafbe1cb', 'request_id': 'req-f7829fe9-8c20-4edb-acb7-99f14b87b190'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:12.098061 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] The token cache is being invalidate because project 879a947d8c564526a5f2d17fdafbe1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 18:59:12.098282 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:12.098902 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-f7829fe9-8c20-4edb-acb7-99f14b87b190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 18:59:12.100382 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1401/2812] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 18:59:12 2021] DELETE /identity/v3/projects/879a947d8c564526a5f2d17fdafbe1cb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 18:59:46.284774 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:59:46.286152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:59:46.371586 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112449-2a97-42d0-bcbe-664d27fbb162 service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:59:46.426117 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:59:46.426781 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:59:46.427061 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:59:46.427334 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:59:46.429096 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 18:59:46.440422 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:59:46.441979 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:59:46.452139 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1412/2813] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 18:59:46 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:01:05.419425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] REQUEST_METHOD: `POST` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:01:05.419923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:01:05.419923 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:01:05.437681 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.auth.core [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] MFA Rules not processed for user `afdb1609b19c483488024719232bdd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=109152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 19:01:05.438928 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:01:05.490016 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1402/2814] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 19:01:05 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 19:01:05.790621 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:01:05.792568 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:01:05.845861 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94301-826f-4c35-b428-340cd82f1501 service placement] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:01:05.850605 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:01:05.851503 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:01:05.851788 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:01:05.852066 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:01:05.854627 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:01:05.866721 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:01:05.868541 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:01:05.876377 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1413/2815] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:01:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:01:24.689539 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:01:24.699870 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c459c8c-6589-4add-9c64-505964c70eb6 None None] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:01:24.703854 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:01:24.704517 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:01:24.704799 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:01:24.705071 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:01:24.707428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:01:24.807094 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:01:24.809189 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:01:24.829142 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1403/2816] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:01:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:02:45.022411 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:02:45.030993 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474466-272b-429f-9580-e6f57abc9cae service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:02:45.034587 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:02:45.035210 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:02:45.035490 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:02:45.035764 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:02:45.037506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:02:45.046576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:02:45.047981 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a360f2-c06b-4ed0-a7fa-ccd078765e2e service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:02:45.055601 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1414/2817] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:02:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:03:16.390659 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:16.392024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:16.464707 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d937e-dece-4919-ba58-02d5bfeca578 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:16.468260 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48e090bca024c92a9cf7c038d225777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:16.468881 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:16.469156 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:16.469425 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:16.471237 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:16.481429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:16.482929 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:16.491984 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1404/2818] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:16 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:03:26.353235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] REQUEST_METHOD: `POST` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:26.353735 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:26.353850 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:26.372286 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.auth.core [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] MFA Rules not processed for user `afdb1609b19c483488024719232bdd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=109153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 19:03:26.373768 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:26.380526 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1415/2819] 10.222.0.36 () {58 vars in 957 bytes} [Mon Oct 18 19:03:26 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 19:03:27.090313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:27.091791 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:27.103576 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:27.106481 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10db96-904d-46f8-8431-a778837f1e91 service cinder] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:27.111462 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:27.112125 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:27.112405 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:27.112677 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:27.113100 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1c87-68e6-4729-903b-8fbb6b178252 None None] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:27.114428 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:27.116885 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:27.117506 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:27.117786 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:27.118059 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:27.119734 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:27.127246 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:27.128813 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:27.133388 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:27.134817 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:27.138522 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1405/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:03:27.146241 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1416/2821] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:27 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 19:03:29.662686 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:29.664138 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:29.683977 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deda70-ecec-4ae3-b2dc-d6887af18a91 service placement] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:29.689976 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:29.690738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:29.691089 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:29.691924 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:29.694054 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:29.707629 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:29.709510 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:29.723211 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1406/2822] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:03:39.938737 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:39.949674 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc35fa-ddf9-4227-90a4-19f0691bbf5d service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:39.955213 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:39.955842 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:39.956118 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:39.956391 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:39.958120 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:39.970108 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:39.971699 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:39.982877 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1417/2823] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:03:42.378134 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:03:42.387576 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8f57-07da-44c6-b614-a6ac3ae6d1dd service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:03:42.391066 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:03:42.391683 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:03:42.391959 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:03:42.392232 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:03:42.393941 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:03:42.452227 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:03:42.453635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:03:42.462737 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1407/2824] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:03:42 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 19:04:51.280153 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:04:51.281518 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:04:51.295451 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8524b4-359f-487c-aa8c-ff3f4cc1b81a service nova] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:04:51.300332 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:04:51.300954 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:04:51.301235 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:04:51.301508 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:04:51.310303 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:04:51.311899 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:04:51.321444 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1418/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:04:51 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:05:34.062296 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:34.075409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ddd9-88d6-4e50-8430-2e16984e75d3 service neutron] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:34.081621 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aabb50c4eb46c78cdf468b3044ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:34.082265 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:34.082568 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:34.082833 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:34.084635 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:34.097078 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:34.098688 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:34.109397 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1408/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:05:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:05:46.200716 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:46.202137 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:46.213887 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabf4e-56af-4f49-a809-7ed36db5ef4b service placement] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:46.217935 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9e3e4d7b9d4bf0858c4c2562eb49e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:46.218606 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] REQUEST_METHOD: `GET` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:46.218884 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:46.219152 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:46.220858 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:46.278523 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:46.279948 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:46.289042 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1419/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:05:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 19:05:52.586311 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:52.587860 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:52.601313 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e71ea-5390-42ef-867f-024245e805f7 service nova] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:52.606301 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:52.607218 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:52.607493 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:52.607762 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] PATH_INFO: `/v3/users/afdb1609b19c483488024719232bdd7b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:52.608944 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdb1609b19c483488024719232bdd7b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:52.610910 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:52.655878 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdb1609b19c483488024719232bdd7b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.669424 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdb1609b19c483488024719232bdd7b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.676029 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdb1609b19c483488024719232bdd7b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.676709 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdb1609b19c483488024719232bdd7b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.677312 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdb1609b19c483488024719232bdd7b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.690102 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1409/2828] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 19:05:52 2021] DELETE /identity/v3/users/afdb1609b19c483488024719232bdd7b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 19:05:52.858905 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:52.868964 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b45b-98fd-40d3-94a1-6a5d838edc7b service neutron] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:52.922742 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:52.923588 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:52.923865 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:52.924138 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] PATH_INFO: `/v3/projects/49ea8b6622bb40109191097fe33b666a` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:52.925308 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ea8b6622bb40109191097fe33b666a)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:52.927233 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:52.968327 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ea8b6622bb40109191097fe33b666a', 'request_id': 'req-db54e62b-1369-411c-ab15-8ea11470bfd0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.973359 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ea8b6622bb40109191097fe33b666a', 'request_id': 'req-db54e62b-1369-411c-ab15-8ea11470bfd0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.980216 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ea8b6622bb40109191097fe33b666a', 'request_id': 'req-db54e62b-1369-411c-ab15-8ea11470bfd0'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.992560 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] The token cache is being invalidate because project 49ea8b6622bb40109191097fe33b666a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 19:05:52.992830 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.993678 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:52.995165 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1420/2829] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 19:05:52 2021] DELETE /identity/v3/projects/49ea8b6622bb40109191097fe33b666a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 19:05:52.999257 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:53.000687 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:53.013328 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4b4d-ee58-49ed-9643-9a7cdd40812a admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:53.067887 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:53.068746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:53.069024 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:53.069297 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] PATH_INFO: `/v3/users/df8b353bcb3e40e3945c3ff2cc9a821b` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:53.070490 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8b353bcb3e40e3945c3ff2cc9a821b)` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:53.072429 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:53.117186 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8b353bcb3e40e3945c3ff2cc9a821b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.128279 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8b353bcb3e40e3945c3ff2cc9a821b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.134746 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8b353bcb3e40e3945c3ff2cc9a821b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.135396 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8b353bcb3e40e3945c3ff2cc9a821b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.136002 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.notifications [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8b353bcb3e40e3945c3ff2cc9a821b'} {{(pid=109152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.148181 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1410/2830] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Oct 18 19:05:52 2021] DELETE /identity/v3/users/df8b353bcb3e40e3945c3ff2cc9a821b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 19:05:53.315062 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Authenticating user token {{(pid=109153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:05:53.316488 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.fernet_utils [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:05:53.331544 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e62b-1369-411c-ab15-8ea11470bfd0 admin admin] Validating token access rules against request {{(pid=109153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:05:53.389167 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccbaff1ca24443ce904c9dbb2942c081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2fba8b4340c45198a97460c74be901e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:05:53.390006 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:05:53.390281 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:05:53.390578 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] PATH_INFO: `/v3/projects/6d90908cbc64405bb0a5aa3be03759cd` {{(pid=109153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:05:53.391732 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d90908cbc64405bb0a5aa3be03759cd)` {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:05:53.393618 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] RBAC: Authorization granted {{(pid=109153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:05:53.436289 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d90908cbc64405bb0a5aa3be03759cd', 'request_id': 'req-f9f7fabb-e8cf-4389-b636-7fba2654c946'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.441347 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d90908cbc64405bb0a5aa3be03759cd', 'request_id': 'req-f9f7fabb-e8cf-4389-b636-7fba2654c946'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.448271 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d90908cbc64405bb0a5aa3be03759cd', 'request_id': 'req-f9f7fabb-e8cf-4389-b636-7fba2654c946'} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.459406 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] The token cache is being invalidate because project 6d90908cbc64405bb0a5aa3be03759cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=109153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 19:05:53.459698 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.460313 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: DEBUG keystone.notifications [None req-f9f7fabb-e8cf-4389-b636-7fba2654c946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=109153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 19:05:53.461806 dv-cinder-813220-2-iscsi devstack@keystone.service[109153]: [pid: 109153|app: 0|req: 1421/2831] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Oct 18 19:05:53 2021] DELETE /identity/v3/projects/6d90908cbc64405bb0a5aa3be03759cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 19:09:56.275975 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Authenticating user token {{(pid=109152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 19:09:56.277409 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:09:56.408653 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88949-6bf7-489d-b3c9-5192108f5120 admin admin] Validating token access rules against request {{(pid=109152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 19:09:56.462738 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047a6b4b18904ee08f9c348948c1e795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f8522db1b9b414ba3ce0a28f49e707a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 19:09:56.463369 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] REQUEST_METHOD: `GET` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 19:09:56.463644 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] SCRIPT_NAME: `/identity` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 19:09:56.463914 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=109152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 19:09:56.465639 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.fernet_utils [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=109152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 19:09:56.476224 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 19:09:56.477777 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebda95-0892-4c0c-8e6f-e66871f0bc2f service placement] RBAC: Authorization granted {{(pid=109152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 19:09:56.489516 dv-cinder-813220-2-iscsi devstack@keystone.service[109152]: [pid: 109152|app: 0|req: 1411/2832] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Oct 18 19:09:56 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)